Apr 12 07:35:02 user nova-compute[82850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 07:35:05 user nova-compute[82850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82850) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82850) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82850) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 07:35:05 user nova-compute[82850]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:35:05 user nova-compute[82850]: INFO nova.virt.driver [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 07:35:05 user nova-compute[82850]: INFO nova.compute.provider_config [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Acquiring lock "singleton_lock" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Acquired lock "singleton_lock" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Releasing lock "singleton_lock" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Full set of CONF: {{(pid=82850) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ******************************************************************************** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Configuration options gathered from: {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ================================================================================ {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] allow_resize_to_same_host      = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] arq_binding_timeout            = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] backdoor_port                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] backdoor_socket                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] block_device_allocate_retries  = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] block_device_allocate_retries_interval = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cert                           = self.pem {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute_monitors               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] config_dir                     = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] config_drive_format            = iso9660 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] config_source                  = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] console_host                   = user {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] control_exchange               = nova {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cpu_allocation_ratio           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] daemon                         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] debug                          = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] default_access_ip_network_name = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] default_availability_zone      = nova {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] default_ephemeral_format       = ext4 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] default_schedule_zone          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] disk_allocation_ratio          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] enable_new_services            = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] enabled_ssl_apis               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] flat_injected                  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] force_config_drive             = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] force_raw_images               = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] graceful_shutdown_timeout      = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] heal_instance_info_cache_interval = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] host                           = user {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_build_timeout         = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_delete_interval       = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_name_template         = instance-%08x {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_usage_audit           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_usage_audit_period    = month {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] internal_service_availability_zone = internal {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] key                            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] live_migration_retry_count     = 30 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:05 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_config_append              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_dir                        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_file                       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_options                    = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_rotate_interval            = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_rotate_interval_type       = days {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] log_rotation_type              = none {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] long_rpc_timeout               = 1800 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_concurrent_builds          = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_concurrent_live_migrations = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_concurrent_snapshots       = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_local_block_devices        = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_logfile_count              = 30 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] max_logfile_size_mb            = 200 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] maximum_instance_delete_attempts = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metadata_listen                = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metadata_listen_port           = 8775 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metadata_workers               = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] migrate_max_retries            = -1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] mkisofs_cmd                    = genisoimage {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] my_ip                          = 10.0.0.210 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] network_allocate_retries       = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] osapi_compute_listen_port      = 8774 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] osapi_compute_unique_server_name_scope =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] osapi_compute_workers          = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] password_length                = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] periodic_enable                = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] periodic_fuzzy_delay           = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] pointer_model                  = ps2mouse {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] preallocate_images             = none {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] publish_errors                 = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] pybasedir                      = /opt/stack/nova {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ram_allocation_ratio           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rate_limit_burst               = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rate_limit_except_level        = CRITICAL {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rate_limit_interval            = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reboot_timeout                 = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reclaim_instance_interval      = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] record                         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reimage_timeout_per_gb         = 20 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] report_interval                = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rescue_timeout                 = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reserved_host_cpus             = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reserved_host_disk_mb          = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reserved_host_memory_mb        = 512 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] reserved_huge_pages            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] resize_confirm_window          = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] resize_fs_using_block_device   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] resume_guests_state_on_host_boot = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rpc_response_timeout           = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] run_external_periodic_tasks    = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] running_deleted_instance_action = reap {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] running_deleted_instance_timeout = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler_instance_sync_interval = 120 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_down_time              = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] servicegroup_driver            = db {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] shelved_offload_time           = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] shelved_poll_interval          = 3600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] shutdown_timeout               = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] source_is_ipv6                 = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ssl_only                       = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] state_path                     = /opt/stack/data/nova {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] sync_power_state_interval      = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] sync_power_state_pool_size     = 1000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] syslog_log_facility            = LOG_USER {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] tempdir                        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] timeout_nbd                    = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] transport_url                  = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] update_resources_interval      = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_cow_images                 = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_eventlog                   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_journal                    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_json                       = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_rootwrap_daemon            = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_stderr                     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] use_syslog                     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vcpu_pin_set                   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plugging_is_fatal          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plugging_timeout           = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] virt_mkfs                      = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] volume_usage_poll_interval     = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] watch_log_file                 = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] web                            = /usr/share/spice-html5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.auth_strategy              = keystone {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.compute_link_prefix        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.dhcp_domain                = novalocal {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.enable_instance_password   = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.glance_link_prefix         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.instance_list_per_project_cells = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.list_records_by_skipping_down_cells = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.local_metadata_per_cell    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.max_limit                  = 1000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.metadata_cache_expiration  = 15 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.neutron_default_tenant_id  = default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.use_forwarded_for          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.use_neutron_default_nets   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_dynamic_targets = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_jsonfile_path   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.backend_argument         = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.config_prefix            = cache.oslo {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.dead_timeout             = 60.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.debug_cache_backend      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.enable_retry_client      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.enable_socket_keepalive  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.enabled                  = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.expiration_time          = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_dead_retry      = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_password        =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_sasl_enabled    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.memcache_username        =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.proxies                  = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.retry_attempts           = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.retry_delay              = 0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.socket_keepalive_count   = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.socket_keepalive_idle    = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.socket_keepalive_interval = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.tls_allowed_ciphers      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.tls_cafile               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.tls_certfile             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.tls_enabled              = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cache.tls_keyfile              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.auth_section            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.auth_type               = password {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.cafile                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.certfile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.collect_timing          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.cross_az_attach         = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.debug                   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.endpoint_template       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.http_retries            = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.insecure                = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.keyfile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.os_region_name          = RegionOne {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.split_loggers           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cinder.timeout                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.cpu_dedicated_set      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.cpu_shared_set         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.image_type_exclude_list = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.resource_provider_association_refresh = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.shutdown_retry_interval = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] conductor.workers              = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] console.allowed_origins        = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] console.ssl_ciphers            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] console.ssl_minimum_version    = default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] consoleauth.token_ttl          = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.cafile                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.certfile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.collect_timing          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.connect_retries         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.connect_retry_delay     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.endpoint_override       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.insecure                = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.keyfile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.max_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.min_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.region_name             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.service_name            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.service_type            = accelerator {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.split_loggers           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.status_code_retries     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.timeout                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] cyborg.version                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.backend               = sqlalchemy {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.connection            = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.connection_debug      = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.connection_parameters =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.connection_recycle_time = 3600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.connection_trace      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.db_inc_retry_interval = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.db_max_retries        = 20 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.db_max_retry_interval = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.db_retry_interval     = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.max_overflow          = 50 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.max_pool_size         = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.max_retries           = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.mysql_enable_ndb      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.pool_timeout          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.retry_interval        = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.slave_connection      = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] database.sqlite_synchronous    = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.backend           = sqlalchemy {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.connection        = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.connection_debug  = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.connection_parameters =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.connection_recycle_time = 3600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.connection_trace  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.db_inc_retry_interval = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.db_max_retries    = 20 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.db_max_retry_interval = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.db_retry_interval = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.max_overflow      = 50 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.max_pool_size     = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.max_retries       = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.mysql_enable_ndb  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.pool_timeout      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.retry_interval    = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.slave_connection  = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] api_database.sqlite_synchronous = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] devices.enabled_mdev_types     = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ephemeral_storage_encryption.enabled = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.api_servers             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.cafile                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.certfile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.collect_timing          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.connect_retries         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.connect_retry_delay     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.debug                   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.default_trusted_certificate_ids = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.enable_certificate_validation = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.enable_rbd_download     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.endpoint_override       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.insecure                = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.keyfile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.max_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.min_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.num_retries             = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.rbd_ceph_conf           =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.rbd_connect_timeout     = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.rbd_pool                =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.rbd_user                =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.region_name             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.service_name            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.service_type            = image {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.split_loggers           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.status_code_retries     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.timeout                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.verify_glance_signatures = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] glance.version                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] guestfs.debug                  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.config_drive_cdrom      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.config_drive_inject_password = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.enable_remotefx         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.instances_path_share    =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.limit_cpu_features      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.use_multipath_io        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.vswitch_name            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] mks.enabled                    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.manager_interval   = 2400 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.precache_concurrency = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.remove_unused_base_images = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] image_cache.subdirectory_name  = _base {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.api_max_retries         = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.api_retry_interval      = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.auth_section            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.auth_type               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.cafile                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.certfile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.collect_timing          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.connect_retries         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.connect_retry_delay     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.endpoint_override       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.insecure                = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.keyfile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.max_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.min_version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.partition_key           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.peer_list               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.region_name             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.serial_console_state_timeout = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.service_name            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.service_type            = baremetal {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.split_loggers           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.status_code_retries     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.timeout                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ironic.version                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] key_manager.fixed_key          = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.barbican_api_version  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.barbican_endpoint     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.barbican_endpoint_type = public {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.barbican_region_name  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.cafile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.certfile              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.collect_timing        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.insecure              = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.keyfile               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.number_of_retries     = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.retry_delay           = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.send_service_user_token = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.split_loggers         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.timeout               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.verify_ssl            = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican.verify_ssl_path       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.auth_section = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.auth_type = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.cafile   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.certfile = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.collect_timing = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.insecure = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.keyfile  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.split_loggers = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] barbican_service_user.timeout  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.approle_role_id          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.approle_secret_id        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.cafile                   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.certfile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.collect_timing           = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.insecure                 = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.keyfile                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.kv_mountpoint            = secret {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.kv_version               = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.namespace                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.root_token_id            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.split_loggers            = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.ssl_ca_crt_file          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.timeout                  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.use_ssl                  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.cafile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.certfile              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.collect_timing        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.connect_retries       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.connect_retry_delay   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.endpoint_override     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.insecure              = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.keyfile               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.max_version           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.min_version           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.region_name           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.service_name          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.service_type          = identity {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.split_loggers         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.status_code_retries   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.timeout               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] keystone.version               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.connection_uri         =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_mode               = custom {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: WARNING oslo_config.cfg [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_power_governor_high = performance {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_power_management   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.device_detach_attempts = 8 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.device_detach_timeout  = 20 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.disk_cachemodes        = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.disk_prefix            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.enabled_perf_events    = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.file_backed_memory     = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.gid_maps               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.hw_disk_discard        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.hw_machine_type        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_rbd_pool        = rbd {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_type            = default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.images_volume_group    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.inject_key             = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.inject_partition       = -2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.inject_password        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.iscsi_iface            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.iser_use_multipath     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_downtime = 500 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_inbound_addr = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_scheme  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_timeout_action = abort {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_tunnelled = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: WARNING oslo_config.cfg [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 07:35:06 user nova-compute[82850]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 07:35:06 user nova-compute[82850]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 07:35:06 user nova-compute[82850]: and ``live_migration_inbound_addr`` respectively.
Apr 12 07:35:06 user nova-compute[82850]: ).  Its value may be silently ignored in the future.
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.live_migration_with_native_tls = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.max_queues             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.nfs_mount_options      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_pcie_ports         = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.pmem_namespaces        = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.quobyte_client_cfg     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rbd_secret_uuid        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rbd_user               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rescue_image_id        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rescue_kernel_id       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.rx_queue_size          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.smbfs_mount_options    =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.snapshot_compression   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.snapshot_image_format  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.sparse_logical_volumes = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.swtpm_enabled          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.swtpm_group            = tss {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.swtpm_user             = tss {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.sysinfo_serial         = unique {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.tx_queue_size          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.uid_maps               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.use_virtio_for_bridges = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.virt_type              = kvm {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.volume_clear           = zero {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.volume_clear_size      = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.volume_use_multipath   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_cache_path   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.auth_section           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.auth_type              = password {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.cafile                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.certfile               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.collect_timing         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.connect_retries        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.connect_retry_delay    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.default_floating_pool  = public {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.endpoint_override      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.extension_sync_interval = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.http_retries           = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.insecure               = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.keyfile                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.max_version            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.min_version            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.ovs_bridge             = br-int {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.physnets               = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.region_name            = RegionOne {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.service_metadata_proxy = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.service_name           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.service_type           = network {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.split_loggers          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.status_code_retries    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.timeout                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] neutron.version                = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] notifications.bdms_in_notifications = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] notifications.default_level    = INFO {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] notifications.notification_format = unversioned {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] notifications.notify_on_state_change = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] pci.alias                      = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] pci.device_spec                = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] pci.report_in_placement        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.auth_section         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.auth_type            = password {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.cafile               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.certfile             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.collect_timing       = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.connect_retries      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.connect_retry_delay  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.default_domain_id    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.default_domain_name  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.domain_id            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.domain_name          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.endpoint_override    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.insecure             = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.keyfile              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.max_version          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.min_version          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.password             = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.project_domain_id    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.project_domain_name  = Default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.project_id           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.project_name         = service {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.region_name          = RegionOne {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.service_name         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.service_type         = placement {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.split_loggers        = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.status_code_retries  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.system_scope         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.timeout              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.trust_id             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.user_domain_id       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.user_domain_name     = Default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.user_id              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.username             = placement {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] placement.version              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.cores                    = 20 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.count_usage_from_placement = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.injected_file_content_bytes = 10240 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.injected_file_path_length = 255 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.injected_files           = 5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.instances                = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.key_pairs                = 100 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.metadata_items           = 128 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.ram                      = 51200 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.recheck_quota            = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.server_group_members     = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] quota.server_groups            = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rdp.enabled                    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.image_metadata_prefilter = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.max_attempts         = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.max_placement_results = 1000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] scheduler.workers              = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.host_subset_size = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.isolated_hosts = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.isolated_images = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.pci_in_placement = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.track_instance_changes = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metrics.required               = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metrics.weight_multiplier      = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] metrics.weight_setting         = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.enabled         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.port_range      = 10000:20000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] serial_console.serialproxy_port = 6083 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.auth_section      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.auth_type         = password {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.cafile            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.certfile          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.collect_timing    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.insecure          = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.keyfile           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.send_service_user_token = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.split_loggers     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] service_user.timeout           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.agent_enabled            = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.enabled                  = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.html5proxy_port          = 6082 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.image_compression        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.jpeg_compression         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.playback_compression     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.server_listen            = 127.0.0.1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.streaming_mode           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] spice.zlib_compression         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] upgrade_levels.baseapi         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] upgrade_levels.cert            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] upgrade_levels.compute         = auto {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] upgrade_levels.conductor       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] upgrade_levels.scheduler       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.cafile = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.certfile = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.insecure = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vendordata_dynamic_auth.timeout = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.api_retry_count         = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.ca_file                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.cache_prefix            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.cluster_name            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.connection_pool_size    = 10 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.console_delay_seconds   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.datastore_regex         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.host_ip                 = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.host_password           = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.host_port               = 443 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.host_username           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.insecure                = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.integration_bridge      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.maximum_objects         = 100 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.pbm_default_policy      = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.pbm_enabled             = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.pbm_wsdl_location       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.serial_port_proxy_uri   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.serial_port_service_uri = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.task_poll_interval      = 0.5 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.use_linked_clone        = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.vnc_keymap              = en-us {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.vnc_port                = 5900 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vmware.vnc_port_total          = 10000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.auth_schemes               = ['none'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.enabled                    = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.novncproxy_port            = 6080 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.vencrypt_ca_certs          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.vencrypt_client_cert       = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vnc.vencrypt_client_key        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.disable_rootwrap   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.enable_numa_live_migration = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.libvirt_disable_apic = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.client_socket_timeout     = 900 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.default_pool_size         = 1000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.keep_alive                = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.max_header_line           = 16384 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.ssl_ca_file               = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.ssl_cert_file             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.ssl_key_file              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.tcp_keepidle              = 600 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] zvm.ca_file                    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] zvm.cloud_connector_url        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] zvm.reachable_timeout          = 300 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.enforce_scope      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.policy_default_rule = default {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.connection_string     = messaging:// {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.enabled               = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.es_doc_type           = notification {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.es_scroll_size        = 10000 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.es_scroll_time        = 2m {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.filter_error_trace    = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.sentinel_service_name = mymaster {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.socket_timeout        = 0.1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] profiler.trace_sqlalchemy      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] remote_debug.host              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] remote_debug.port              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.auth_section        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.auth_type           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.cafile              = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.certfile            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.collect_timing      = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.connect_retries     = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.connect_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.endpoint_id         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.endpoint_override   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.insecure            = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.keyfile             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.max_version         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.min_version         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.region_name         = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.service_name        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.service_type        = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.split_loggers       = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.status_code_retries = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.status_code_retry_delay = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.timeout             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.valid_interfaces    = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_limit.version             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_reports.file_event_handler = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] oslo_reports.log_dir           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.group  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] vif_plug_ovs_privileged.user   = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.isolate_vif         = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] os_brick.lock_path             = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.capabilities   = [21] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.group          = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.helper_command = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] privsep_osbrick.user           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.group           = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.helper_command  = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] nova_sys_admin.user            = None {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG oslo_service.service [None req-8f606b76-1c9e-4f4a-ace3-4837ea119ba8 None None] ******************************************************************************** {{(pid=82850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 07:35:06 user nova-compute[82850]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Starting native event thread {{(pid=82850) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Starting green dispatch thread {{(pid=82850) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Starting connection event dispatch thread {{(pid=82850) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Connecting to libvirt: qemu:///system {{(pid=82850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f194debe620> {{(pid=82850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f194debe620> {{(pid=82850) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 07:35:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Connection event '1' reason 'None'
Apr 12 07:35:06 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 07:35:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.mount [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Initialising _HostMountState generation 0 {{(pid=82850) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 07:35:13 user nova-compute[82850]: INFO nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host capabilities <capabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <host>
Apr 12 07:35:13 user nova-compute[82850]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 07:35:13 user nova-compute[82850]:     <cpu>
Apr 12 07:35:13 user nova-compute[82850]:       <arch>x86_64</arch>
Apr 12 07:35:13 user nova-compute[82850]:       <model>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <microcode version='1070'/>
Apr 12 07:35:13 user nova-compute[82850]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='osxsave'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='invtsc'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='rsba'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 07:35:13 user nova-compute[82850]:       <pages unit='KiB' size='4'/>
Apr 12 07:35:13 user nova-compute[82850]:       <pages unit='KiB' size='2048'/>
Apr 12 07:35:13 user nova-compute[82850]:     </cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <power_management>
Apr 12 07:35:13 user nova-compute[82850]:       <suspend_mem/>
Apr 12 07:35:13 user nova-compute[82850]:       <suspend_disk/>
Apr 12 07:35:13 user nova-compute[82850]:       <suspend_hybrid/>
Apr 12 07:35:13 user nova-compute[82850]:     </power_management>
Apr 12 07:35:13 user nova-compute[82850]:     <iommu support='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <migration_features>
Apr 12 07:35:13 user nova-compute[82850]:       <live/>
Apr 12 07:35:13 user nova-compute[82850]:       <uri_transports>
Apr 12 07:35:13 user nova-compute[82850]:         <uri_transport>tcp</uri_transport>
Apr 12 07:35:13 user nova-compute[82850]:         <uri_transport>rdma</uri_transport>
Apr 12 07:35:13 user nova-compute[82850]:       </uri_transports>
Apr 12 07:35:13 user nova-compute[82850]:     </migration_features>
Apr 12 07:35:13 user nova-compute[82850]:     <topology>
Apr 12 07:35:13 user nova-compute[82850]:       <cells num='2'>
Apr 12 07:35:13 user nova-compute[82850]:         <cell id='0'>
Apr 12 07:35:13 user nova-compute[82850]:           <memory unit='KiB'>8152920</memory>
Apr 12 07:35:13 user nova-compute[82850]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 12 07:35:13 user nova-compute[82850]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 07:35:13 user nova-compute[82850]:           <distances>
Apr 12 07:35:13 user nova-compute[82850]:             <sibling id='0' value='10'/>
Apr 12 07:35:13 user nova-compute[82850]:             <sibling id='1' value='20'/>
Apr 12 07:35:13 user nova-compute[82850]:           </distances>
Apr 12 07:35:13 user nova-compute[82850]:           <cpus num='6'>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 07:35:13 user nova-compute[82850]:           </cpus>
Apr 12 07:35:13 user nova-compute[82850]:         </cell>
Apr 12 07:35:13 user nova-compute[82850]:         <cell id='1'>
Apr 12 07:35:13 user nova-compute[82850]:           <memory unit='KiB'>8255068</memory>
Apr 12 07:35:13 user nova-compute[82850]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 12 07:35:13 user nova-compute[82850]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 07:35:13 user nova-compute[82850]:           <distances>
Apr 12 07:35:13 user nova-compute[82850]:             <sibling id='0' value='20'/>
Apr 12 07:35:13 user nova-compute[82850]:             <sibling id='1' value='10'/>
Apr 12 07:35:13 user nova-compute[82850]:           </distances>
Apr 12 07:35:13 user nova-compute[82850]:           <cpus num='6'>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 07:35:13 user nova-compute[82850]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 07:35:13 user nova-compute[82850]:           </cpus>
Apr 12 07:35:13 user nova-compute[82850]:         </cell>
Apr 12 07:35:13 user nova-compute[82850]:       </cells>
Apr 12 07:35:13 user nova-compute[82850]:     </topology>
Apr 12 07:35:13 user nova-compute[82850]:     <cache>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 07:35:13 user nova-compute[82850]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 07:35:13 user nova-compute[82850]:     </cache>
Apr 12 07:35:13 user nova-compute[82850]:     <secmodel>
Apr 12 07:35:13 user nova-compute[82850]:       <model>apparmor</model>
Apr 12 07:35:13 user nova-compute[82850]:       <doi>0</doi>
Apr 12 07:35:13 user nova-compute[82850]:     </secmodel>
Apr 12 07:35:13 user nova-compute[82850]:     <secmodel>
Apr 12 07:35:13 user nova-compute[82850]:       <model>dac</model>
Apr 12 07:35:13 user nova-compute[82850]:       <doi>0</doi>
Apr 12 07:35:13 user nova-compute[82850]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 07:35:13 user nova-compute[82850]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 07:35:13 user nova-compute[82850]:     </secmodel>
Apr 12 07:35:13 user nova-compute[82850]:   </host>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='alpha'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>clipper</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='armv6l'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>spitz</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>nuri</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>kzm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>z2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>tosa</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n810</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>terrier</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>midway</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>microbit</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>verdex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>highbank</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>akita</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>connex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>collie</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='armv7l'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>spitz</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>nuri</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>kzm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>z2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>tosa</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n810</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>terrier</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>midway</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>microbit</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>verdex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>highbank</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>akita</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>connex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>collie</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='aarch64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>spitz</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>nuri</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>kzm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>z2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>tosa</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n810</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>n800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>terrier</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>midway</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>microbit</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>verdex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>highbank</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>akita</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>connex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>collie</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <acpi default='on' toggle='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='cris'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='i686'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>isapc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>microvm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='kvm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <pae/>
Apr 12 07:35:13 user nova-compute[82850]:       <nonpae/>
Apr 12 07:35:13 user nova-compute[82850]:       <acpi default='on' toggle='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:       <apic default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='m68k'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>an5206</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>q800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='microblaze'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='microblazeel'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='mips'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>malta</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='mipsel'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>malta</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='mips64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>malta</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>pica61</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>magnum</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='mips64el'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>malta</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>pica61</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>magnum</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='16'>boston</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='ppc'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mac99</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>40p</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>taihu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='ppc64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>taihu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>40p</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mac99</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='ppc64le'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>taihu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>40p</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>mac99</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='riscv32'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='8'>spike</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='8'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='riscv64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='8'>spike</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='8'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='s390x'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='sh4'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>shix</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>r2d</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='sh4eb'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>shix</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>r2d</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='sparc'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>LX</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='sparc64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>niagara</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='x86_64'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>64</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='1'>isapc</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>microvm</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='kvm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <acpi default='on' toggle='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:       <apic default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='xtensa'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>sim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>kc705</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ml605</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx200</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx60</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]:   <guest>
Apr 12 07:35:13 user nova-compute[82850]:     <os_type>hvm</os_type>
Apr 12 07:35:13 user nova-compute[82850]:     <arch name='xtensaeb'>
Apr 12 07:35:13 user nova-compute[82850]:       <wordsize>32</wordsize>
Apr 12 07:35:13 user nova-compute[82850]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='4'>sim</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>kc705</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ml605</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>virt</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx200</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>lx60</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 07:35:13 user nova-compute[82850]:       <domain type='qemu'/>
Apr 12 07:35:13 user nova-compute[82850]:     </arch>
Apr 12 07:35:13 user nova-compute[82850]:     <features>
Apr 12 07:35:13 user nova-compute[82850]:       <cpuselection/>
Apr 12 07:35:13 user nova-compute[82850]:       <deviceboot/>
Apr 12 07:35:13 user nova-compute[82850]:       <disksnapshot default='on' toggle='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     </features>
Apr 12 07:35:13 user nova-compute[82850]:   </guest>
Apr 12 07:35:13 user nova-compute[82850]: </capabilities>
Apr 12 07:35:13 user nova-compute[82850]: 
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-i440fx-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>i686</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='255'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'/>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='lm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ide</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-i440fx-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>i686</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='255'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'/>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='lm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ide</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-q35-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>i686</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='288'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'/>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='lm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-q35-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>i686</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='288'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'/>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='lm'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-i440fx-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>x86_64</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='255'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>efi</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='invtsc'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='rsba'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ide</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-i440fx-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>x86_64</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='255'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>efi</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='invtsc'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='rsba'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ide</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-q35-6.2</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>x86_64</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='288'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>efi</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='invtsc'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='rsba'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 07:35:13 user nova-compute[82850]: <domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 07:35:13 user nova-compute[82850]:   <domain>kvm</domain>
Apr 12 07:35:13 user nova-compute[82850]:   <machine>pc-q35-jammy</machine>
Apr 12 07:35:13 user nova-compute[82850]:   <arch>x86_64</arch>
Apr 12 07:35:13 user nova-compute[82850]:   <vcpu max='288'/>
Apr 12 07:35:13 user nova-compute[82850]:   <iothreads supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:   <os supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='firmware'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>efi</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:     <loader supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>rom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pflash</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='readonly'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='secure'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>yes</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>no</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </loader>
Apr 12 07:35:13 user nova-compute[82850]:   </os>
Apr 12 07:35:13 user nova-compute[82850]:   <cpu>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-passthrough' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='hostPassthroughMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='maximum' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='maximumMigratable'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>on</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>off</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='host-model' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <vendor>Intel</vendor>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ss'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='vmx'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pcid'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='hypervisor'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arat'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='umip'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='md-clear'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='invtsc'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibpb'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='ibrs'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-stibp'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='rsba'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='erms'/>
Apr 12 07:35:13 user nova-compute[82850]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:     <mode name='custom' supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>qemu64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>qemu32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>phenom</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>pentium</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>n270</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm64</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>kvm32</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>coreduo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>core2duo</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>athlon</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Westmere</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Snowridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Skylake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>SandyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Penryn</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G5</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G4</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G3</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Opteron_G2</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Opteron_G1</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>IvyBridge</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Icelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Haswell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Rome</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-Milan</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>EPYC</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Dhyana</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cooperlake</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>Conroe</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='no'>Broadwell</model>
Apr 12 07:35:13 user nova-compute[82850]:       <model usable='yes'>486</model>
Apr 12 07:35:13 user nova-compute[82850]:     </mode>
Apr 12 07:35:13 user nova-compute[82850]:   </cpu>
Apr 12 07:35:13 user nova-compute[82850]:   <memoryBacking supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:     <enum name='sourceType'>
Apr 12 07:35:13 user nova-compute[82850]:       <value>file</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>anonymous</value>
Apr 12 07:35:13 user nova-compute[82850]:       <value>memfd</value>
Apr 12 07:35:13 user nova-compute[82850]:     </enum>
Apr 12 07:35:13 user nova-compute[82850]:   </memoryBacking>
Apr 12 07:35:13 user nova-compute[82850]:   <devices>
Apr 12 07:35:13 user nova-compute[82850]:     <disk supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='diskDevice'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>disk</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cdrom</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>floppy</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>lun</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='bus'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>fdc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sata</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </disk>
Apr 12 07:35:13 user nova-compute[82850]:     <graphics supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='type'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>sdl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vnc</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>spice</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egl-headless</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </graphics>
Apr 12 07:35:13 user nova-compute[82850]:     <video supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='modelType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>cirrus</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>vmvga</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>qxl</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>none</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>bochs</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>ramfb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </video>
Apr 12 07:35:13 user nova-compute[82850]:     <hostdev supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='mode'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>subsystem</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='startupPolicy'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>default</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>mandatory</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>requisite</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>optional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='subsysType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>usb</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>pci</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>scsi</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='capsType'/>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='pciBackend'/>
Apr 12 07:35:13 user nova-compute[82850]:     </hostdev>
Apr 12 07:35:13 user nova-compute[82850]:     <rng supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtio-non-transitional</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>random</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>egd</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>builtin</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </rng>
Apr 12 07:35:13 user nova-compute[82850]:     <filesystem supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='driverType'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>path</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>handle</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>virtiofs</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </filesystem>
Apr 12 07:35:13 user nova-compute[82850]:     <tpm supported='yes'>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='model'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-tis</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>tpm-crb</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:       <enum name='backendModel'>
Apr 12 07:35:13 user nova-compute[82850]:         <value>passthrough</value>
Apr 12 07:35:13 user nova-compute[82850]:         <value>emulator</value>
Apr 12 07:35:13 user nova-compute[82850]:       </enum>
Apr 12 07:35:13 user nova-compute[82850]:     </tpm>
Apr 12 07:35:13 user nova-compute[82850]:   </devices>
Apr 12 07:35:13 user nova-compute[82850]:   <features>
Apr 12 07:35:13 user nova-compute[82850]:     <gic supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:     <vmcoreinfo supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <genid supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backingStoreInput supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <backup supported='yes'/>
Apr 12 07:35:13 user nova-compute[82850]:     <sev supported='no'/>
Apr 12 07:35:13 user nova-compute[82850]:   </features>
Apr 12 07:35:13 user nova-compute[82850]: </domainCapabilities>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82850) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82850) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Checking secure boot support for host arch (x86_64) {{(pid=82850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Checking secure boot support for host arch (x86_64) {{(pid=82850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Checking secure boot support for host arch (x86_64) {{(pid=82850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Checking secure boot support for host arch (x86_64) {{(pid=82850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Checking secure boot support for host arch (x86_64) {{(pid=82850) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 07:35:13 user nova-compute[82850]: INFO nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Secure Boot support detected
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] cpu compare xml: <cpu match="exact">
Apr 12 07:35:13 user nova-compute[82850]:   <model>Nehalem</model>
Apr 12 07:35:13 user nova-compute[82850]: </cpu>
Apr 12 07:35:13 user nova-compute[82850]:  {{(pid=82850) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 07:35:13 user nova-compute[82850]: INFO nova.virt.node [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Generated node identity 27ffe403-b11c-48c3-a0f8-372b48def01d
Apr 12 07:35:13 user nova-compute[82850]: INFO nova.virt.node [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Wrote node identity 27ffe403-b11c-48c3-a0f8-372b48def01d to /opt/stack/data/nova/compute_id
Apr 12 07:35:13 user nova-compute[82850]: WARNING nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Compute nodes ['27ffe403-b11c-48c3-a0f8-372b48def01d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 07:35:13 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 07:35:13 user nova-compute[82850]: WARNING nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 07:35:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:35:13 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:35:14 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:35:14 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Hypervisor/Node resource view: name=user free_ram=10779MB free_disk=26.98499298095703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:35:14 user nova-compute[82850]: WARNING nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] No compute node record for user:27ffe403-b11c-48c3-a0f8-372b48def01d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 27ffe403-b11c-48c3-a0f8-372b48def01d could not be found.
Apr 12 07:35:14 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Compute node record created for user:user with uuid: 27ffe403-b11c-48c3-a0f8-372b48def01d
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:35:14 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [req-6c753d4c-6209-4151-bc78-e0399d3c67c2] Created resource provider record via placement API for resource provider with UUID 27ffe403-b11c-48c3-a0f8-372b48def01d and name user.
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82850) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 07:35:14 user nova-compute[82850]: INFO nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] kernel doesn't support AMD SEV
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Libvirt baseline CPU <cpu>
Apr 12 07:35:14 user nova-compute[82850]:   <arch>x86_64</arch>
Apr 12 07:35:14 user nova-compute[82850]:   <model>Nehalem</model>
Apr 12 07:35:14 user nova-compute[82850]:   <vendor>Intel</vendor>
Apr 12 07:35:14 user nova-compute[82850]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 07:35:14 user nova-compute[82850]: </cpu>
Apr 12 07:35:14 user nova-compute[82850]:  {{(pid=82850) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Updated inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Updating resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d generation from 0 to 1 during operation: update_inventory {{(pid=82850) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Updating resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d generation from 1 to 2 during operation: update_traits {{(pid=82850) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.service [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Creating RPC server for service compute {{(pid=82850) start /opt/stack/nova/nova/service.py:182}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.service [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Join ServiceGroup membership for this service compute {{(pid=82850) start /opt/stack/nova/nova/service.py:199}}
Apr 12 07:35:14 user nova-compute[82850]: DEBUG nova.servicegroup.drivers.db [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82850) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 07:35:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:35:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:36:05 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:36:06 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:36:06 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=10133MB free_disk=26.898780822753906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:36:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:37:06 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:37:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:37:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=10108MB free_disk=26.94469451904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:37:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:37:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:37:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:38:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:38:07 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:38:08 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:38:08 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=10159MB free_disk=26.72088623046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:38:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:38:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:08 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:39:09 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:09 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=9422MB free_disk=26.751869201660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:39:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:15 user nova-compute[82850]: INFO nova.compute.claims [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Claim successful on node user
Apr 12 07:39:15 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:15 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Creating image(s)
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "/opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "/opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG nova.policy [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9da4c1fc6e54f7a8c780f9450b9f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1237d4763c436fbbeaf03fad8ee570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.part --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG nova.virt.images [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 68a0a523-85da-4c40-ac88-5d5f304c0b18 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.part /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.part /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.converted" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.892s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:17 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2d3_f6_o/privsep.sock']
Apr 12 07:39:17 user sudo[91572]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2d3_f6_o/privsep.sock
Apr 12 07:39:17 user sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 07:39:18 user sudo[91572]: pam_unix(sudo:session): session closed for user root
Apr 12 07:39:18 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Spawned new privsep daemon via rootwrap
Apr 12 07:39:18 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 07:39:18 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 07:39:18 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 07:39:18 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91575
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk 1073741824" returned: 0 in 0.040s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Cannot resize image /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG nova.objects.instance [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lazy-loading 'migration_context' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Successfully created port: 5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:21 user nova-compute[82850]: INFO nova.compute.claims [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Claim successful on node user
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:21 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:21 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:22 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Creating image(s)
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "/opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "/opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "/opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk 1073741824" returned: 0 in 0.040s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.policy [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.115s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Cannot resize image /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.objects.instance [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'migration_context' on Instance uuid e21b1323-aafd-4989-92c0-3ba5b45ba2bc {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Ensure instance console log exists: /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:23 user nova-compute[82850]: INFO nova.compute.claims [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Claim successful on node user
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Creating image(s)
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:23 user nova-compute[82850]: DEBUG nova.policy [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk 1073741824" returned: 0 in 0.084s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Successfully updated port: 5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquired lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:24 user nova-compute[82850]: INFO nova.compute.claims [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Claim successful on node user
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.398s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Cannot resize image /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-changed-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Refreshing instance network info cache due to event network-changed-5b484c80-547c-43a2-8b8b-432bc559c1fc. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Acquiring lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.455s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:25 user nova-compute[82850]: INFO nova.compute.claims [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Claim successful on node user
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating image(s)
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.policy [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.172s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk 1073741824" returned: 0 in 0.047s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.167s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Creating image(s)
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Cannot resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'migration_context' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Successfully created port: d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Ensure instance console log exists: /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updating instance_info_cache with network_info: [{"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Releasing lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Instance network_info: |[{"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Acquired lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.neutron [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Refreshing network info cache for port 5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Start _get_guest_xml network_info=[{"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:26 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:26 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-347260054',display_name='tempest-DeleteServersTestJSON-server-347260054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-347260054',id=1,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1237d4763c436fbbeaf03fad8ee570',ramdisk_id='',reservation_id='r-zl0c9zwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1756098866',owner_user_name='tempest-DeleteServersTestJSON-1756098866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:16Z,user_data=None,user_id='b9da4c1fc6e54f7a8c780f9450b9f826',uuid=4f40c85d-313c-4485-8131-37d4c53441d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converting VIF {"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.216s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:26 user nova-compute[82850]:   <uuid>4f40c85d-313c-4485-8131-37d4c53441d7</uuid>
Apr 12 07:39:26 user nova-compute[82850]:   <name>instance-00000001</name>
Apr 12 07:39:26 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:26 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:26 user nova-compute[82850]:   <metadata>
Apr 12 07:39:26 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:26 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:name>tempest-DeleteServersTestJSON-server-347260054</nova:name>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:26</nova:creationTime>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:26 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:26 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:user uuid="b9da4c1fc6e54f7a8c780f9450b9f826">tempest-DeleteServersTestJSON-1756098866-project-member</nova:user>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:project uuid="4a1237d4763c436fbbeaf03fad8ee570">tempest-DeleteServersTestJSON-1756098866</nova:project>
Apr 12 07:39:26 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:26 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:26 user nova-compute[82850]:         <nova:port uuid="5b484c80-547c-43a2-8b8b-432bc559c1fc">
Apr 12 07:39:26 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 07:39:26 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:26 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:26 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:26 user nova-compute[82850]:   </metadata>
Apr 12 07:39:26 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:26 user nova-compute[82850]:     <system>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="serial">4f40c85d-313c-4485-8131-37d4c53441d7</entry>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="uuid">4f40c85d-313c-4485-8131-37d4c53441d7</entry>
Apr 12 07:39:26 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:26 user nova-compute[82850]:     </system>
Apr 12 07:39:26 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:26 user nova-compute[82850]:   <os>
Apr 12 07:39:26 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:26 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:26 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:26 user nova-compute[82850]:   </os>
Apr 12 07:39:26 user nova-compute[82850]:   <features>
Apr 12 07:39:26 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:26 user nova-compute[82850]:     <apic/>
Apr 12 07:39:26 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:26 user nova-compute[82850]:   </features>
Apr 12 07:39:26 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:26 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:26 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:26 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:26 user nova-compute[82850]:   </clock>
Apr 12 07:39:26 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:26 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:26 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:26 user nova-compute[82850]:   </cpu>
Apr 12 07:39:26 user nova-compute[82850]:   <devices>
Apr 12 07:39:26 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:26 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:26 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk"/>
Apr 12 07:39:26 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:26 user nova-compute[82850]:     </disk>
Apr 12 07:39:26 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:26 user nova-compute[82850]:       <mac address="fa:16:3e:db:e0:27"/>
Apr 12 07:39:26 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:26 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:26 user nova-compute[82850]:       <target dev="tap5b484c80-54"/>
Apr 12 07:39:26 user nova-compute[82850]:     </interface>
Apr 12 07:39:26 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:26 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/console.log" append="off"/>
Apr 12 07:39:26 user nova-compute[82850]:     </serial>
Apr 12 07:39:26 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:26 user nova-compute[82850]:     <video>
Apr 12 07:39:26 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:26 user nova-compute[82850]:     </video>
Apr 12 07:39:26 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:26 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:26 user nova-compute[82850]:     </rng>
Apr 12 07:39:26 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:26 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:26 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:26 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:26 user nova-compute[82850]:   </devices>
Apr 12 07:39:26 user nova-compute[82850]: </domain>
Apr 12 07:39:26 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-347260054',display_name='tempest-DeleteServersTestJSON-server-347260054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-347260054',id=1,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1237d4763c436fbbeaf03fad8ee570',ramdisk_id='',reservation_id='r-zl0c9zwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1756098866',owner_user_name='tempest-DeleteServersTestJSON-1756098866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:16Z,user_data=None,user_id='b9da4c1fc6e54f7a8c780f9450b9f826',uuid=4f40c85d-313c-4485-8131-37d4c53441d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converting VIF {"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG os_vif [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.policy [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Created schema index Interface.name {{(pid=82850) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Created schema index Port.name {{(pid=82850) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Created schema index Bridge.name {{(pid=82850) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [POLLOUT] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.207s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk 1073741824" returned: 0 in 0.096s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:26 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjnypm4pi/privsep.sock']
Apr 12 07:39:26 user sudo[91667]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjnypm4pi/privsep.sock
Apr 12 07:39:26 user sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Cannot resize image /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Ensure instance console log exists: /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Successfully created port: 833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updated VIF entry in instance network info cache for port 5b484c80-547c-43a2-8b8b-432bc559c1fc. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updating instance_info_cache with network_info: [{"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Releasing lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Successfully created port: d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:28 user nova-compute[82850]: INFO nova.compute.claims [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Claim successful on node user
Apr 12 07:39:28 user sudo[91667]: pam_unix(sudo:session): session closed for user root
Apr 12 07:39:28 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Spawned new privsep daemon via rootwrap
Apr 12 07:39:28 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 07:39:28 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 07:39:28 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 07:39:28 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91676
Apr 12 07:39:28 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:28 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b484c80-54, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b484c80-54, col_values=(('external_ids', {'iface-id': '5b484c80-547c-43a2-8b8b-432bc559c1fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:e0:27', 'vm-uuid': '4f40c85d-313c-4485-8131-37d4c53441d7'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:29 user nova-compute[82850]: INFO os_vif [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54')
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Creating image(s)
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] No VIF found with MAC fa:16:3e:db:e0:27, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Successfully created port: 72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.policy [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Successfully updated port: d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquired lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk 1073741824" returned: 0 in 0.072s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.165s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Cannot resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.objects.instance [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'migration_context' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Ensure instance console log exists: /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Successfully updated port: 833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-changed-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Refreshing instance network info cache due to event network-changed-d739ef84-c04b-4cbc-b836-4bf88483d1a4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Acquiring lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:30 user nova-compute[82850]: INFO nova.compute.claims [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Claim successful on node user
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-changed-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Refreshing instance network info cache due to event network-changed-833dbd18-9190-4c45-8724-b57e1f46efcb. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:30 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:30 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Creating image(s)
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updating instance_info_cache with network_info: [{"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Releasing lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Instance network_info: |[{"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Acquired lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.neutron [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Refreshing network info cache for port d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Start _get_guest_xml network_info=[{"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.policy [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593219528',display_name='tempest-ServersNegativeTestJSON-server-593219528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593219528',id=2,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-osw7omys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:22Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=e21b1323-aafd-4989-92c0-3ba5b45ba2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.objects.instance [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'pci_devices' on Instance uuid e21b1323-aafd-4989-92c0-3ba5b45ba2bc {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:31 user nova-compute[82850]:   <uuid>e21b1323-aafd-4989-92c0-3ba5b45ba2bc</uuid>
Apr 12 07:39:31 user nova-compute[82850]:   <name>instance-00000002</name>
Apr 12 07:39:31 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:31 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:31 user nova-compute[82850]:   <metadata>
Apr 12 07:39:31 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:31 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:name>tempest-ServersNegativeTestJSON-server-593219528</nova:name>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:31</nova:creationTime>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:31 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:user uuid="4b61df1643964059b70eba466af4b6db">tempest-ServersNegativeTestJSON-1126238824-project-member</nova:user>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:project uuid="2b1ea22b656f42ab9e8d117b0ff11b3a">tempest-ServersNegativeTestJSON-1126238824</nova:project>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:port uuid="d739ef84-c04b-4cbc-b836-4bf88483d1a4">
Apr 12 07:39:31 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 07:39:31 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:31 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:31 user nova-compute[82850]:   </metadata>
Apr 12 07:39:31 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:31 user nova-compute[82850]:     <system>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="serial">e21b1323-aafd-4989-92c0-3ba5b45ba2bc</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="uuid">e21b1323-aafd-4989-92c0-3ba5b45ba2bc</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:31 user nova-compute[82850]:     </system>
Apr 12 07:39:31 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:31 user nova-compute[82850]:   <os>
Apr 12 07:39:31 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:31 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:31 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:31 user nova-compute[82850]:   </os>
Apr 12 07:39:31 user nova-compute[82850]:   <features>
Apr 12 07:39:31 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:31 user nova-compute[82850]:     <apic/>
Apr 12 07:39:31 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:31 user nova-compute[82850]:   </features>
Apr 12 07:39:31 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:31 user nova-compute[82850]:   </clock>
Apr 12 07:39:31 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:31 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:31 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:31 user nova-compute[82850]:   </cpu>
Apr 12 07:39:31 user nova-compute[82850]:   <devices>
Apr 12 07:39:31 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:31 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:31 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk"/>
Apr 12 07:39:31 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:     </disk>
Apr 12 07:39:31 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:31 user nova-compute[82850]:       <mac address="fa:16:3e:30:03:69"/>
Apr 12 07:39:31 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:31 user nova-compute[82850]:       <target dev="tapd739ef84-c0"/>
Apr 12 07:39:31 user nova-compute[82850]:     </interface>
Apr 12 07:39:31 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:31 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/console.log" append="off"/>
Apr 12 07:39:31 user nova-compute[82850]:     </serial>
Apr 12 07:39:31 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:31 user nova-compute[82850]:     <video>
Apr 12 07:39:31 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:     </video>
Apr 12 07:39:31 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:31 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:31 user nova-compute[82850]:     </rng>
Apr 12 07:39:31 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:31 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:31 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:31 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:31 user nova-compute[82850]:   </devices>
Apr 12 07:39:31 user nova-compute[82850]: </domain>
Apr 12 07:39:31 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593219528',display_name='tempest-ServersNegativeTestJSON-server-593219528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593219528',id=2,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-osw7omys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:22Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=e21b1323-aafd-4989-92c0-3ba5b45ba2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG os_vif [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk 1073741824" returned: 0 in 0.053s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd739ef84-c0, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd739ef84-c0, col_values=(('external_ids', {'iface-id': 'd739ef84-c04b-4cbc-b836-4bf88483d1a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:03:69', 'vm-uuid': 'e21b1323-aafd-4989-92c0-3ba5b45ba2bc'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: INFO os_vif [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0')
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] No VIF found with MAC fa:16:3e:30:03:69, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance network_info: |[{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.neutron [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Refreshing network info cache for port 833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start _get_guest_xml network_info=[{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-226648607',display_name='tempest-ServerRescueNegativeTestJSON-server-226648607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-226648607',id=3,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-mxh96aw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:24Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Cannot resize image /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.objects.instance [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'migration_context' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Ensure instance console log exists: /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:31 user nova-compute[82850]:   <uuid>e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</uuid>
Apr 12 07:39:31 user nova-compute[82850]:   <name>instance-00000003</name>
Apr 12 07:39:31 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:31 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:31 user nova-compute[82850]:   <metadata>
Apr 12 07:39:31 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:31 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-226648607</nova:name>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:31</nova:creationTime>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:31 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:31 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:31 user nova-compute[82850]:         <nova:port uuid="833dbd18-9190-4c45-8724-b57e1f46efcb">
Apr 12 07:39:31 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 07:39:31 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:31 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:31 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:31 user nova-compute[82850]:   </metadata>
Apr 12 07:39:31 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:31 user nova-compute[82850]:     <system>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="serial">e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="uuid">e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</entry>
Apr 12 07:39:31 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:31 user nova-compute[82850]:     </system>
Apr 12 07:39:31 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:31 user nova-compute[82850]:   <os>
Apr 12 07:39:31 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:31 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:31 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:31 user nova-compute[82850]:   </os>
Apr 12 07:39:31 user nova-compute[82850]:   <features>
Apr 12 07:39:31 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:31 user nova-compute[82850]:     <apic/>
Apr 12 07:39:31 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:31 user nova-compute[82850]:   </features>
Apr 12 07:39:31 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:31 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:31 user nova-compute[82850]:   </clock>
Apr 12 07:39:31 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:31 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:31 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:31 user nova-compute[82850]:   </cpu>
Apr 12 07:39:31 user nova-compute[82850]:   <devices>
Apr 12 07:39:31 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:31 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:31 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk"/>
Apr 12 07:39:31 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:     </disk>
Apr 12 07:39:31 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:31 user nova-compute[82850]:       <mac address="fa:16:3e:79:b2:43"/>
Apr 12 07:39:31 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:31 user nova-compute[82850]:       <target dev="tap833dbd18-91"/>
Apr 12 07:39:31 user nova-compute[82850]:     </interface>
Apr 12 07:39:31 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:31 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/console.log" append="off"/>
Apr 12 07:39:31 user nova-compute[82850]:     </serial>
Apr 12 07:39:31 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:31 user nova-compute[82850]:     <video>
Apr 12 07:39:31 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:31 user nova-compute[82850]:     </video>
Apr 12 07:39:31 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:31 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:31 user nova-compute[82850]:     </rng>
Apr 12 07:39:31 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:31 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:31 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:31 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:31 user nova-compute[82850]:   </devices>
Apr 12 07:39:31 user nova-compute[82850]: </domain>
Apr 12 07:39:31 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-226648607',display_name='tempest-ServerRescueNegativeTestJSON-server-226648607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-226648607',id=3,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-mxh96aw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:24Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG os_vif [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap833dbd18-91, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap833dbd18-91, col_values=(('external_ids', {'iface-id': '833dbd18-9190-4c45-8724-b57e1f46efcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:b2:43', 'vm-uuid': 'e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:31 user nova-compute[82850]: INFO os_vif [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91')
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:79:b2:43, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Successfully updated port: d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] No waiting events found dispatching network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:32 user nova-compute[82850]: WARNING nova.compute.manager [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received unexpected event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc for instance with vm_state building and task_state spawning.
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-changed-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Refreshing instance network info cache due to event network-changed-d24db70b-543b-4549-8c33-b8276a776c3d. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285172.3091135, 4f40c85d-313c-4485-8131-37d4c53441d7 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] VM Resumed (Lifecycle Event)
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Instance spawned successfully.
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285172.3119836, 4f40c85d-313c-4485-8131-37d4c53441d7 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] VM Started (Lifecycle Event)
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Took 16.02 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:32 user nova-compute[82850]: INFO nova.compute.manager [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Took 17.03 seconds to build instance.
Apr 12 07:39:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.217s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updated VIF entry in instance network info cache for port 833dbd18-9190-4c45-8724-b57e1f46efcb. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updated VIF entry in instance network info cache for port d739ef84-c04b-4cbc-b836-4bf88483d1a4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updating instance_info_cache with network_info: [{"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Releasing lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Successfully created port: 40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance network_info: |[{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Refreshing network info cache for port d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start _get_guest_xml network_info=[{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-2004380288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.objects.instance [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Successfully updated port: 72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Successfully created port: 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:34 user nova-compute[82850]:   <uuid>3b7424e4-52aa-4330-a748-006240372716</uuid>
Apr 12 07:39:34 user nova-compute[82850]:   <name>instance-00000004</name>
Apr 12 07:39:34 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:34 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:34 user nova-compute[82850]:   <metadata>
Apr 12 07:39:34 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:34 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-2004380288</nova:name>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:34</nova:creationTime>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:34 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:34 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:39:34 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:34 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:34 user nova-compute[82850]:         <nova:port uuid="d24db70b-543b-4549-8c33-b8276a776c3d">
Apr 12 07:39:34 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:39:34 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:34 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:34 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:34 user nova-compute[82850]:   </metadata>
Apr 12 07:39:34 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:34 user nova-compute[82850]:     <system>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="serial">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="uuid">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:39:34 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:34 user nova-compute[82850]:     </system>
Apr 12 07:39:34 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:34 user nova-compute[82850]:   <os>
Apr 12 07:39:34 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:34 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:34 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:34 user nova-compute[82850]:   </os>
Apr 12 07:39:34 user nova-compute[82850]:   <features>
Apr 12 07:39:34 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:34 user nova-compute[82850]:     <apic/>
Apr 12 07:39:34 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:34 user nova-compute[82850]:   </features>
Apr 12 07:39:34 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:34 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:34 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:34 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:34 user nova-compute[82850]:   </clock>
Apr 12 07:39:34 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:34 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:34 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:34 user nova-compute[82850]:   </cpu>
Apr 12 07:39:34 user nova-compute[82850]:   <devices>
Apr 12 07:39:34 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:34 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:34 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk"/>
Apr 12 07:39:34 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:34 user nova-compute[82850]:     </disk>
Apr 12 07:39:34 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:34 user nova-compute[82850]:       <mac address="fa:16:3e:d5:f3:b1"/>
Apr 12 07:39:34 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:34 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:34 user nova-compute[82850]:       <target dev="tapd24db70b-54"/>
Apr 12 07:39:34 user nova-compute[82850]:     </interface>
Apr 12 07:39:34 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:34 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log" append="off"/>
Apr 12 07:39:34 user nova-compute[82850]:     </serial>
Apr 12 07:39:34 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:34 user nova-compute[82850]:     <video>
Apr 12 07:39:34 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:34 user nova-compute[82850]:     </video>
Apr 12 07:39:34 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:34 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:34 user nova-compute[82850]:     </rng>
Apr 12 07:39:34 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:34 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:34 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:34 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:34 user nova-compute[82850]:   </devices>
Apr 12 07:39:34 user nova-compute[82850]: </domain>
Apr 12 07:39:34 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-2004380288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG os_vif [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-changed-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Refreshing instance network info cache due to event network-changed-72eb7ca6-62de-4e4f-b40f-52343e160945. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] No waiting events found dispatching network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:34 user nova-compute[82850]: WARNING nova.compute.manager [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received unexpected event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc for instance with vm_state active and task_state None.
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24db70b-54, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd24db70b-54, col_values=(('external_ids', {'iface-id': 'd24db70b-543b-4549-8c33-b8276a776c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f3:b1', 'vm-uuid': '3b7424e4-52aa-4330-a748-006240372716'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:34 user nova-compute[82850]: INFO os_vif [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:d5:f3:b1, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance network_info: |[{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Refreshing network info cache for port 72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start _get_guest_xml network_info=[{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:36 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:36 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377191038',display_name='tempest-ServerRescueNegativeTestJSON-server-377191038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377191038',id=5,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-1nh4kdns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:26Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=acbd6126-210b-41cf-a994-528233e5369b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.objects.instance [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updated VIF entry in instance network info cache for port d24db70b-543b-4549-8c33-b8276a776c3d. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:36 user nova-compute[82850]: WARNING nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state building and task_state spawning.
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:36 user nova-compute[82850]: WARNING nova.compute.manager [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state building and task_state spawning.
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] No waiting events found dispatching network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:36 user nova-compute[82850]: WARNING nova.compute.manager [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received unexpected event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance with vm_state building and task_state spawning.
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:36 user nova-compute[82850]:   <uuid>acbd6126-210b-41cf-a994-528233e5369b</uuid>
Apr 12 07:39:36 user nova-compute[82850]:   <name>instance-00000005</name>
Apr 12 07:39:36 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:36 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:36 user nova-compute[82850]:   <metadata>
Apr 12 07:39:36 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:36 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377191038</nova:name>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:36</nova:creationTime>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:36 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:36 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:39:36 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:36 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:36 user nova-compute[82850]:         <nova:port uuid="72eb7ca6-62de-4e4f-b40f-52343e160945">
Apr 12 07:39:36 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 07:39:36 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:36 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:36 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:36 user nova-compute[82850]:   </metadata>
Apr 12 07:39:36 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:36 user nova-compute[82850]:     <system>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="serial">acbd6126-210b-41cf-a994-528233e5369b</entry>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="uuid">acbd6126-210b-41cf-a994-528233e5369b</entry>
Apr 12 07:39:36 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:36 user nova-compute[82850]:     </system>
Apr 12 07:39:36 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:36 user nova-compute[82850]:   <os>
Apr 12 07:39:36 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:36 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:36 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:36 user nova-compute[82850]:   </os>
Apr 12 07:39:36 user nova-compute[82850]:   <features>
Apr 12 07:39:36 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:36 user nova-compute[82850]:     <apic/>
Apr 12 07:39:36 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:36 user nova-compute[82850]:   </features>
Apr 12 07:39:36 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:36 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:36 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:36 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:36 user nova-compute[82850]:   </clock>
Apr 12 07:39:36 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:36 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:36 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:36 user nova-compute[82850]:   </cpu>
Apr 12 07:39:36 user nova-compute[82850]:   <devices>
Apr 12 07:39:36 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:36 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:36 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk"/>
Apr 12 07:39:36 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:36 user nova-compute[82850]:     </disk>
Apr 12 07:39:36 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:36 user nova-compute[82850]:       <mac address="fa:16:3e:6c:18:60"/>
Apr 12 07:39:36 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:36 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:36 user nova-compute[82850]:       <target dev="tap72eb7ca6-62"/>
Apr 12 07:39:36 user nova-compute[82850]:     </interface>
Apr 12 07:39:36 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:36 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/console.log" append="off"/>
Apr 12 07:39:36 user nova-compute[82850]:     </serial>
Apr 12 07:39:36 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:36 user nova-compute[82850]:     <video>
Apr 12 07:39:36 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:36 user nova-compute[82850]:     </video>
Apr 12 07:39:36 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:36 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:36 user nova-compute[82850]:     </rng>
Apr 12 07:39:36 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:36 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:36 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:36 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:36 user nova-compute[82850]:   </devices>
Apr 12 07:39:36 user nova-compute[82850]: </domain>
Apr 12 07:39:36 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377191038',display_name='tempest-ServerRescueNegativeTestJSON-server-377191038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377191038',id=5,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-1nh4kdns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:26Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=acbd6126-210b-41cf-a994-528233e5369b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG os_vif [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72eb7ca6-62, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72eb7ca6-62, col_values=(('external_ids', {'iface-id': '72eb7ca6-62de-4e4f-b40f-52343e160945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:18:60', 'vm-uuid': 'acbd6126-210b-41cf-a994-528233e5369b'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: INFO os_vif [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62')
Apr 12 07:39:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:6c:18:60, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Successfully updated port: 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing instance network info cache due to event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Successfully updated port: 40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updated VIF entry in instance network info cache for port 72eb7ca6-62de-4e4f-b40f-52343e160945. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285178.1055205, e21b1323-aafd-4989-92c0-3ba5b45ba2bc => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] VM Resumed (Lifecycle Event)
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Instance spawned successfully.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285178.117599, e21b1323-aafd-4989-92c0-3ba5b45ba2bc => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] VM Started (Lifecycle Event)
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Took 16.29 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:38 user nova-compute[82850]: WARNING nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state building and task_state spawning.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:38 user nova-compute[82850]: WARNING nova.compute.manager [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state building and task_state spawning.
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Took 17.00 seconds to build instance.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.188s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance network_info: |[{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start _get_guest_xml network_info=[{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.objects.instance [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'pci_devices' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] No waiting events found dispatching network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:38 user nova-compute[82850]: WARNING nova.compute.manager [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received unexpected event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance with vm_state active and task_state None.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-changed-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Refreshing instance network info cache due to event network-changed-40ca8897-7180-4ef1-91f2-29b18afbcc25. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Refreshing network info cache for port 40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:38 user nova-compute[82850]:   <uuid>f79ca8ec-41b5-4b60-882f-d74d906fb8e6</uuid>
Apr 12 07:39:38 user nova-compute[82850]:   <name>instance-00000006</name>
Apr 12 07:39:38 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:38 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:38 user nova-compute[82850]:   <metadata>
Apr 12 07:39:38 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:38 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeTestJSON-server-1794309151</nova:name>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:38</nova:creationTime>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:38 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:38 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:user uuid="a555fa5e6680420e80fcc925a7540806">tempest-AttachVolumeTestJSON-1353175840-project-member</nova:user>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:project uuid="f7915d29fb124c838093eba0ee6cb69c">tempest-AttachVolumeTestJSON-1353175840</nova:project>
Apr 12 07:39:38 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:38 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:38 user nova-compute[82850]:         <nova:port uuid="40ca8897-7180-4ef1-91f2-29b18afbcc25">
Apr 12 07:39:38 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:39:38 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:38 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:38 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:38 user nova-compute[82850]:   </metadata>
Apr 12 07:39:38 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:38 user nova-compute[82850]:     <system>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="serial">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="uuid">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:39:38 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:38 user nova-compute[82850]:     </system>
Apr 12 07:39:38 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:38 user nova-compute[82850]:   <os>
Apr 12 07:39:38 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:38 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:38 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:38 user nova-compute[82850]:   </os>
Apr 12 07:39:38 user nova-compute[82850]:   <features>
Apr 12 07:39:38 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:38 user nova-compute[82850]:     <apic/>
Apr 12 07:39:38 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:38 user nova-compute[82850]:   </features>
Apr 12 07:39:38 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:38 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:38 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:38 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:38 user nova-compute[82850]:   </clock>
Apr 12 07:39:38 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:38 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:38 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:38 user nova-compute[82850]:   </cpu>
Apr 12 07:39:38 user nova-compute[82850]:   <devices>
Apr 12 07:39:38 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:38 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:38 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk"/>
Apr 12 07:39:38 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:38 user nova-compute[82850]:     </disk>
Apr 12 07:39:38 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:38 user nova-compute[82850]:       <mac address="fa:16:3e:b7:ec:08"/>
Apr 12 07:39:38 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:38 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:38 user nova-compute[82850]:       <target dev="tap40ca8897-71"/>
Apr 12 07:39:38 user nova-compute[82850]:     </interface>
Apr 12 07:39:38 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:38 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/console.log" append="off"/>
Apr 12 07:39:38 user nova-compute[82850]:     </serial>
Apr 12 07:39:38 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:38 user nova-compute[82850]:     <video>
Apr 12 07:39:38 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:38 user nova-compute[82850]:     </video>
Apr 12 07:39:38 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:38 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:38 user nova-compute[82850]:     </rng>
Apr 12 07:39:38 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:38 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:38 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:38 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:38 user nova-compute[82850]:   </devices>
Apr 12 07:39:38 user nova-compute[82850]: </domain>
Apr 12 07:39:38 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG os_vif [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40ca8897-71, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40ca8897-71, col_values=(('external_ids', {'iface-id': '40ca8897-7180-4ef1-91f2-29b18afbcc25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ec:08', 'vm-uuid': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285178.8411422, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Resumed (Lifecycle Event)
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:38 user nova-compute[82850]: INFO os_vif [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance spawned successfully.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285178.844426, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Started (Lifecycle Event)
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:39 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No VIF found with MAC fa:16:3e:b7:ec:08, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:39 user nova-compute[82850]: INFO nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Took 15.24 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: INFO nova.compute.manager [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Took 15.95 seconds to build instance.
Apr 12 07:39:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.126s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance network_info: |[{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start _get_guest_xml network_info=[{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2050028382',display_name='tempest-ServerStableDeviceRescueTest-server-2050028382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2050028382',id=7,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqw+fRFEXzo2E8zYD8tNpcWZ3Dbiukx9cAFsZUU+hROJOSEqpmsx5UgbhAUOur9dqTbsQ7BQg01ufaydX8WNt+5So3ZMdUF8LLxFa/deh6yQ8CHMyjzOmnF4ex9Z+eEQQ==',key_name='tempest-keypair-777808843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3578114ca9476ca280abc2e4f83b11',ramdisk_id='',reservation_id='r-hrepuju0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-473420304',owner_user_name='tempest-ServerStableDeviceRescueTest-473420304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d67cdd754c467dbe2760ede6f4218d',uuid=69aeabdc-65e3-4af2-9f8b-3699778c6b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converting VIF {"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.objects.instance [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'pci_devices' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:39 user nova-compute[82850]:   <uuid>69aeabdc-65e3-4af2-9f8b-3699778c6b89</uuid>
Apr 12 07:39:39 user nova-compute[82850]:   <name>instance-00000007</name>
Apr 12 07:39:39 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:39 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:39 user nova-compute[82850]:   <metadata>
Apr 12 07:39:39 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:39 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2050028382</nova:name>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:39</nova:creationTime>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:39 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:39 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:user uuid="b3d67cdd754c467dbe2760ede6f4218d">tempest-ServerStableDeviceRescueTest-473420304-project-member</nova:user>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:project uuid="bc3578114ca9476ca280abc2e4f83b11">tempest-ServerStableDeviceRescueTest-473420304</nova:project>
Apr 12 07:39:39 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:39 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:39 user nova-compute[82850]:         <nova:port uuid="0b334cc7-e101-4fdc-9a60-98cf9c11d7ca">
Apr 12 07:39:39 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 07:39:39 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:39 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:39 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:39 user nova-compute[82850]:   </metadata>
Apr 12 07:39:39 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:39 user nova-compute[82850]:     <system>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="serial">69aeabdc-65e3-4af2-9f8b-3699778c6b89</entry>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="uuid">69aeabdc-65e3-4af2-9f8b-3699778c6b89</entry>
Apr 12 07:39:39 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:39 user nova-compute[82850]:     </system>
Apr 12 07:39:39 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:39 user nova-compute[82850]:   <os>
Apr 12 07:39:39 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:39 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:39 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:39 user nova-compute[82850]:   </os>
Apr 12 07:39:39 user nova-compute[82850]:   <features>
Apr 12 07:39:39 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:39 user nova-compute[82850]:     <apic/>
Apr 12 07:39:39 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:39 user nova-compute[82850]:   </features>
Apr 12 07:39:39 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:39 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:39 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:39 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:39 user nova-compute[82850]:   </clock>
Apr 12 07:39:39 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:39 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:39 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:39 user nova-compute[82850]:   </cpu>
Apr 12 07:39:39 user nova-compute[82850]:   <devices>
Apr 12 07:39:39 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:39 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:39 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk"/>
Apr 12 07:39:39 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:39 user nova-compute[82850]:     </disk>
Apr 12 07:39:39 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:39 user nova-compute[82850]:       <mac address="fa:16:3e:71:22:82"/>
Apr 12 07:39:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:39 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:39 user nova-compute[82850]:       <target dev="tap0b334cc7-e1"/>
Apr 12 07:39:39 user nova-compute[82850]:     </interface>
Apr 12 07:39:39 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:39 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/console.log" append="off"/>
Apr 12 07:39:39 user nova-compute[82850]:     </serial>
Apr 12 07:39:39 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:39 user nova-compute[82850]:     <video>
Apr 12 07:39:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:39 user nova-compute[82850]:     </video>
Apr 12 07:39:39 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:39 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:39 user nova-compute[82850]:     </rng>
Apr 12 07:39:39 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:39 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:39 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:39 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:39 user nova-compute[82850]:   </devices>
Apr 12 07:39:39 user nova-compute[82850]: </domain>
Apr 12 07:39:39 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2050028382',display_name='tempest-ServerStableDeviceRescueTest-server-2050028382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2050028382',id=7,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqw+fRFEXzo2E8zYD8tNpcWZ3Dbiukx9cAFsZUU+hROJOSEqpmsx5UgbhAUOur9dqTbsQ7BQg01ufaydX8WNt+5So3ZMdUF8LLxFa/deh6yQ8CHMyjzOmnF4ex9Z+eEQQ==',key_name='tempest-keypair-777808843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3578114ca9476ca280abc2e4f83b11',ramdisk_id='',reservation_id='r-hrepuju0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-473420304',owner_user_name='tempest-ServerStableDeviceRescueTest-473420304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d67cdd754c467dbe2760ede6f4218d',uuid=69aeabdc-65e3-4af2-9f8b-3699778c6b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converting VIF {"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG os_vif [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b334cc7-e1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b334cc7-e1, col_values=(('external_ids', {'iface-id': '0b334cc7-e101-4fdc-9a60-98cf9c11d7ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:22:82', 'vm-uuid': '69aeabdc-65e3-4af2-9f8b-3699778c6b89'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:39 user nova-compute[82850]: INFO os_vif [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1')
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updated VIF entry in instance network info cache for port 40ca8897-7180-4ef1-91f2-29b18afbcc25. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No VIF found with MAC fa:16:3e:71:22:82, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:40 user nova-compute[82850]: WARNING nova.compute.manager [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state building and task_state spawning.
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285180.8677232, 3b7424e4-52aa-4330-a748-006240372716 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Resumed (Lifecycle Event)
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance spawned successfully.
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:40 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285180.8748028, 3b7424e4-52aa-4330-a748-006240372716 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Started (Lifecycle Event)
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updated VIF entry in instance network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Took 15.70 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285181.4679673, acbd6126-210b-41cf-a994-528233e5369b => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] VM Resumed (Lifecycle Event)
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Took 17.13 seconds to build instance.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.279s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance spawned successfully.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285181.4780111, acbd6126-210b-41cf-a994-528233e5369b => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] VM Started (Lifecycle Event)
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Took 15.48 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:41 user nova-compute[82850]: INFO nova.compute.manager [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Took 17.05 seconds to build instance.
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.440s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:42 user nova-compute[82850]: WARNING nova.compute.manager [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state building and task_state spawning.
Apr 12 07:39:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:43 user nova-compute[82850]: WARNING nova.compute.manager [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state active and task_state None.
Apr 12 07:39:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:45 user nova-compute[82850]: WARNING nova.compute.manager [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state building and task_state spawning.
Apr 12 07:39:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285185.739558, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Resumed (Lifecycle Event)
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:45 user nova-compute[82850]: WARNING nova.compute.manager [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state building and task_state spawning.
Apr 12 07:39:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance spawned successfully.
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285185.7409868, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Started (Lifecycle Event)
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance spawned successfully.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285186.003963, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Resumed (Lifecycle Event)
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Took 15.26 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285186.012999, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Started (Lifecycle Event)
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Took 17.30 seconds to spawn the instance on the hypervisor.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Took 16.36 seconds to build instance.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.576s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:46 user nova-compute[82850]: INFO nova.compute.manager [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Took 18.30 seconds to build instance.
Apr 12 07:39:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.472s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:48 user nova-compute[82850]: WARNING nova.compute.manager [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state active and task_state None.
Apr 12 07:39:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:50 user nova-compute[82850]: INFO nova.compute.claims [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Claim successful on node user
Apr 12 07:39:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.080s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:39:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:39:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Creating image(s)
Apr 12 07:39:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "/opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "/opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "/opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.182s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG nova.policy [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9750ae336a14eb3b0bcc849aa67a026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5fc0e264e047c1b874854907be678e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.225s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk 1073741824" returned: 0 in 0.122s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.281s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Cannot resize image /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:39:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'migration_context' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:39:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Ensure instance console log exists: /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:39:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Successfully created port: e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:39:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Successfully updated port: e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquired lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-changed-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Refreshing instance network info cache due to event network-changed-e0de1b4f-faa3-4c31-8cdd-25dff971246c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Acquiring lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:39:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updating instance_info_cache with network_info: [{"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Releasing lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Instance network_info: |[{"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Acquired lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Refreshing network info cache for port e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Start _get_guest_xml network_info=[{"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:39:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-121117445',display_name='tempest-TestVolumeSwap-server-121117445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-121117445',id=8,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuq866s8odsIKE37byvvUyVR3YuvoZgZXYSLaRELlwoAt9hhpQPlm37tUV+pXMWu8zJzK90JzS8xUWF9C/JZP8a9zHIGWrSX9Qk3HRbCHg72zVGm71AkqUtFO0R5xTNFQ==',key_name='tempest-keypair-1332528006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5fc0e264e047c1b874854907be678e',ramdisk_id='',reservation_id='r-1u7sbqr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-564837731',owner_user_name='tempest-TestVolumeSwap-564837731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9750ae336a14eb3b0bcc849aa67a026',uuid=eee310e4-bed8-405f-bfc6-a6bc3085293d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converting VIF {"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'pci_devices' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:39:56 user nova-compute[82850]:   <uuid>eee310e4-bed8-405f-bfc6-a6bc3085293d</uuid>
Apr 12 07:39:56 user nova-compute[82850]:   <name>instance-00000008</name>
Apr 12 07:39:56 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:39:56 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:39:56 user nova-compute[82850]:   <metadata>
Apr 12 07:39:56 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:39:56 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:name>tempest-TestVolumeSwap-server-121117445</nova:name>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:39:56</nova:creationTime>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:39:56 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:39:56 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:owner>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:user uuid="f9750ae336a14eb3b0bcc849aa67a026">tempest-TestVolumeSwap-564837731-project-member</nova:user>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:project uuid="0e5fc0e264e047c1b874854907be678e">tempest-TestVolumeSwap-564837731</nova:project>
Apr 12 07:39:56 user nova-compute[82850]:       </nova:owner>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:39:56 user nova-compute[82850]:       <nova:ports>
Apr 12 07:39:56 user nova-compute[82850]:         <nova:port uuid="e0de1b4f-faa3-4c31-8cdd-25dff971246c">
Apr 12 07:39:56 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 07:39:56 user nova-compute[82850]:         </nova:port>
Apr 12 07:39:56 user nova-compute[82850]:       </nova:ports>
Apr 12 07:39:56 user nova-compute[82850]:     </nova:instance>
Apr 12 07:39:56 user nova-compute[82850]:   </metadata>
Apr 12 07:39:56 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:39:56 user nova-compute[82850]:     <system>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="serial">eee310e4-bed8-405f-bfc6-a6bc3085293d</entry>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="uuid">eee310e4-bed8-405f-bfc6-a6bc3085293d</entry>
Apr 12 07:39:56 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:39:56 user nova-compute[82850]:     </system>
Apr 12 07:39:56 user nova-compute[82850]:   </sysinfo>
Apr 12 07:39:56 user nova-compute[82850]:   <os>
Apr 12 07:39:56 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:39:56 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:39:56 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:39:56 user nova-compute[82850]:   </os>
Apr 12 07:39:56 user nova-compute[82850]:   <features>
Apr 12 07:39:56 user nova-compute[82850]:     <acpi/>
Apr 12 07:39:56 user nova-compute[82850]:     <apic/>
Apr 12 07:39:56 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:39:56 user nova-compute[82850]:   </features>
Apr 12 07:39:56 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:39:56 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:39:56 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:39:56 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:39:56 user nova-compute[82850]:   </clock>
Apr 12 07:39:56 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:39:56 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:39:56 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:39:56 user nova-compute[82850]:   </cpu>
Apr 12 07:39:56 user nova-compute[82850]:   <devices>
Apr 12 07:39:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:39:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:39:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk"/>
Apr 12 07:39:56 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:39:56 user nova-compute[82850]:     </disk>
Apr 12 07:39:56 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:39:56 user nova-compute[82850]:       <mac address="fa:16:3e:6a:52:ac"/>
Apr 12 07:39:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:56 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:39:56 user nova-compute[82850]:       <target dev="tape0de1b4f-fa"/>
Apr 12 07:39:56 user nova-compute[82850]:     </interface>
Apr 12 07:39:56 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:39:56 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/console.log" append="off"/>
Apr 12 07:39:56 user nova-compute[82850]:     </serial>
Apr 12 07:39:56 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:39:56 user nova-compute[82850]:     <video>
Apr 12 07:39:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:39:56 user nova-compute[82850]:     </video>
Apr 12 07:39:56 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:39:56 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:39:56 user nova-compute[82850]:     </rng>
Apr 12 07:39:56 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:39:56 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:39:56 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:39:56 user nova-compute[82850]:     </memballoon>
Apr 12 07:39:56 user nova-compute[82850]:   </devices>
Apr 12 07:39:56 user nova-compute[82850]: </domain>
Apr 12 07:39:56 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-121117445',display_name='tempest-TestVolumeSwap-server-121117445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-121117445',id=8,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuq866s8odsIKE37byvvUyVR3YuvoZgZXYSLaRELlwoAt9hhpQPlm37tUV+pXMWu8zJzK90JzS8xUWF9C/JZP8a9zHIGWrSX9Qk3HRbCHg72zVGm71AkqUtFO0R5xTNFQ==',key_name='tempest-keypair-1332528006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5fc0e264e047c1b874854907be678e',ramdisk_id='',reservation_id='r-1u7sbqr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-564837731',owner_user_name='tempest-TestVolumeSwap-564837731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9750ae336a14eb3b0bcc849aa67a026',uuid=eee310e4-bed8-405f-bfc6-a6bc3085293d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converting VIF {"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG os_vif [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0de1b4f-fa, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0de1b4f-fa, col_values=(('external_ids', {'iface-id': 'e0de1b4f-faa3-4c31-8cdd-25dff971246c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:52:ac', 'vm-uuid': 'eee310e4-bed8-405f-bfc6-a6bc3085293d'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:56 user nova-compute[82850]: INFO os_vif [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa')
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:39:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] No VIF found with MAC fa:16:3e:6a:52:ac, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:39:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updated VIF entry in instance network info cache for port e0de1b4f-faa3-4c31-8cdd-25dff971246c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:39:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updating instance_info_cache with network_info: [{"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:39:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Releasing lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:39:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] No waiting events found dispatching network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:39:58 user nova-compute[82850]: WARNING nova.compute.manager [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received unexpected event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance with vm_state building and task_state spawning.
Apr 12 07:39:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:39:59 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:39:59 user nova-compute[82850]: INFO nova.compute.claims [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Claim successful on node user
Apr 12 07:40:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:40:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:40:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Creating image(s)
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "/opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "/opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.policy [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:40:00 user nova-compute[82850]: INFO nova.compute.claims [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Claim successful on node user
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.174s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] No waiting events found dispatching network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:01 user nova-compute[82850]: WARNING nova.compute.manager [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received unexpected event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance with vm_state building and task_state spawning.
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk 1073741824" returned: 0 in 0.282s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.460s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Cannot resize image /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.objects.instance [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'migration_context' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285201.5331004, eee310e4-bed8-405f-bfc6-a6bc3085293d => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] VM Resumed (Lifecycle Event)
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Instance spawned successfully.
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.policy [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Successfully created port: f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285201.5351362, eee310e4-bed8-405f-bfc6-a6bc3085293d => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] VM Started (Lifecycle Event)
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Creating image(s)
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Took 9.81 seconds to spawn the instance on the hypervisor.
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:01 user nova-compute[82850]: INFO nova.compute.manager [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Took 11.71 seconds to build instance.
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.166s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.957s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.170s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk 1073741824" returned: 0 in 0.066s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:40:02 user nova-compute[82850]: INFO nova.compute.claims [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Claim successful on node user
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.188s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Successfully created port: 49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Successfully updated port: f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquired lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-changed-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Refreshing instance network info cache due to event network-changed-f5da504b-425d-45d4-a150-7399af15f563. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Acquiring lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Cannot resize image /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'migration_context' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Ensure instance console log exists: /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updating instance_info_cache with network_info: [{"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Releasing lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Instance network_info: |[{"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Acquired lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Refreshing network info cache for port f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Start _get_guest_xml network_info=[{"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:40:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359303190',display_name='tempest-VolumesAdminNegativeTest-server-1359303190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359303190',id=9,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrg4uHMBkAMw3UoqXTbvqnDFv+1eFvHSIxqnyVVNp9NtV1YTHEmXxQnYA72VxlIYNV/oW5eS6gzorv3tPjOcZ97EcXqfkecc1MgFQlMPDaeUsR9Ha/s9A4emn7MslwQtw==',key_name='tempest-keypair-827036857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-1hg95u4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de4929e67ed472b90e95066b2c50340',uuid=d4f9729d-3114-4fc6-a704-02f436c17614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:40:03 user nova-compute[82850]:   <uuid>d4f9729d-3114-4fc6-a704-02f436c17614</uuid>
Apr 12 07:40:03 user nova-compute[82850]:   <name>instance-00000009</name>
Apr 12 07:40:03 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:40:03 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:40:03 user nova-compute[82850]:   <metadata>
Apr 12 07:40:03 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:40:03 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1359303190</nova:name>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:40:03</nova:creationTime>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:40:03 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:40:03 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:owner>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:user uuid="8de4929e67ed472b90e95066b2c50340">tempest-VolumesAdminNegativeTest-407566417-project-member</nova:user>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:project uuid="19a93f4d88764fd49cd8b2eb9ff1cb8f">tempest-VolumesAdminNegativeTest-407566417</nova:project>
Apr 12 07:40:03 user nova-compute[82850]:       </nova:owner>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:40:03 user nova-compute[82850]:       <nova:ports>
Apr 12 07:40:03 user nova-compute[82850]:         <nova:port uuid="f5da504b-425d-45d4-a150-7399af15f563">
Apr 12 07:40:03 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 07:40:03 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:03 user nova-compute[82850]:       </nova:ports>
Apr 12 07:40:03 user nova-compute[82850]:     </nova:instance>
Apr 12 07:40:03 user nova-compute[82850]:   </metadata>
Apr 12 07:40:03 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:40:03 user nova-compute[82850]:     <system>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="serial">d4f9729d-3114-4fc6-a704-02f436c17614</entry>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="uuid">d4f9729d-3114-4fc6-a704-02f436c17614</entry>
Apr 12 07:40:03 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:40:03 user nova-compute[82850]:     </system>
Apr 12 07:40:03 user nova-compute[82850]:   </sysinfo>
Apr 12 07:40:03 user nova-compute[82850]:   <os>
Apr 12 07:40:03 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:40:03 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:40:03 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:40:03 user nova-compute[82850]:   </os>
Apr 12 07:40:03 user nova-compute[82850]:   <features>
Apr 12 07:40:03 user nova-compute[82850]:     <acpi/>
Apr 12 07:40:03 user nova-compute[82850]:     <apic/>
Apr 12 07:40:03 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:40:03 user nova-compute[82850]:   </features>
Apr 12 07:40:03 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:40:03 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:40:03 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:40:03 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:40:03 user nova-compute[82850]:   </clock>
Apr 12 07:40:03 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:40:03 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:40:03 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:40:03 user nova-compute[82850]:   </cpu>
Apr 12 07:40:03 user nova-compute[82850]:   <devices>
Apr 12 07:40:03 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:40:03 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:40:03 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk"/>
Apr 12 07:40:03 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:40:03 user nova-compute[82850]:     </disk>
Apr 12 07:40:03 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:03 user nova-compute[82850]:       <mac address="fa:16:3e:88:83:08"/>
Apr 12 07:40:03 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:03 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:03 user nova-compute[82850]:       <target dev="tapf5da504b-42"/>
Apr 12 07:40:03 user nova-compute[82850]:     </interface>
Apr 12 07:40:03 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:40:03 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/console.log" append="off"/>
Apr 12 07:40:03 user nova-compute[82850]:     </serial>
Apr 12 07:40:03 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:40:03 user nova-compute[82850]:     <video>
Apr 12 07:40:03 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:03 user nova-compute[82850]:     </video>
Apr 12 07:40:03 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:40:03 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:40:03 user nova-compute[82850]:     </rng>
Apr 12 07:40:03 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:40:03 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:40:03 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:40:03 user nova-compute[82850]:     </memballoon>
Apr 12 07:40:03 user nova-compute[82850]:   </devices>
Apr 12 07:40:03 user nova-compute[82850]: </domain>
Apr 12 07:40:03 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359303190',display_name='tempest-VolumesAdminNegativeTest-server-1359303190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359303190',id=9,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrg4uHMBkAMw3UoqXTbvqnDFv+1eFvHSIxqnyVVNp9NtV1YTHEmXxQnYA72VxlIYNV/oW5eS6gzorv3tPjOcZ97EcXqfkecc1MgFQlMPDaeUsR9Ha/s9A4emn7MslwQtw==',key_name='tempest-keypair-827036857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-1hg95u4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de4929e67ed472b90e95066b2c50340',uuid=d4f9729d-3114-4fc6-a704-02f436c17614,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG os_vif [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5da504b-42, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5da504b-42, col_values=(('external_ids', {'iface-id': 'f5da504b-425d-45d4-a150-7399af15f563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:83:08', 'vm-uuid': 'd4f9729d-3114-4fc6-a704-02f436c17614'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:03 user nova-compute[82850]: INFO os_vif [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42')
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No VIF found with MAC fa:16:3e:88:83:08, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:40:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Creating image(s)
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Successfully updated port: 49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.policy [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1945c498db466dba6c16af19ff42d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7b4669bf684bdaa24332f6821c7186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-changed-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing instance network info cache due to event network-changed-49ee8142-11f3-45a6-8a4d-be1968aa1ca1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing network info cache for port 49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.part --force-share --output=json" returned: 0 in 0.169s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.virt.images [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] e37a17a0-55cd-4c56-a320-ff10e65f48f7 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.part /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updated VIF entry in instance network info cache for port f5da504b-425d-45d4-a150-7399af15f563. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updating instance_info_cache with network_info: [{"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Releasing lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.part /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.converted" returned: 0 in 0.189s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.913s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json" returned: 0 in 0.166s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f,backing_fmt=raw /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f,backing_fmt=raw /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk 1073741824" returned: 0 in 0.071s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "cd1f99e1db6af5ee60c11f02b30877912d7f3d0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] No waiting events found dispatching network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:04 user nova-compute[82850]: WARNING nova.compute.manager [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received unexpected event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 for instance with vm_state building and task_state spawning.
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Cannot resize image /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'migration_context' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Ensure instance console log exists: /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance network_info: |[{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Start _get_guest_xml network_info=[{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:40:05 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:05 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'pci_devices' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:40:05 user nova-compute[82850]:   <uuid>62827796-517b-46bd-acb2-98247fa081f4</uuid>
Apr 12 07:40:05 user nova-compute[82850]:   <name>instance-0000000a</name>
Apr 12 07:40:05 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:40:05 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:40:05 user nova-compute[82850]:   <metadata>
Apr 12 07:40:05 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:40:05 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:name>tempest-device-tagging-server-1072053691</nova:name>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:40:05</nova:creationTime>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:40:05 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:40:05 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:owner>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:user uuid="0082023d624048c796622b4142d89ab6">tempest-TaggedAttachmentsTest-1393321118-project-member</nova:user>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:project uuid="a790f72405ee4b4ca977ba829dbd8971">tempest-TaggedAttachmentsTest-1393321118</nova:project>
Apr 12 07:40:05 user nova-compute[82850]:       </nova:owner>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:40:05 user nova-compute[82850]:       <nova:ports>
Apr 12 07:40:05 user nova-compute[82850]:         <nova:port uuid="49ee8142-11f3-45a6-8a4d-be1968aa1ca1">
Apr 12 07:40:05 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:40:05 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:05 user nova-compute[82850]:       </nova:ports>
Apr 12 07:40:05 user nova-compute[82850]:     </nova:instance>
Apr 12 07:40:05 user nova-compute[82850]:   </metadata>
Apr 12 07:40:05 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:40:05 user nova-compute[82850]:     <system>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="serial">62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="uuid">62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:40:05 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:40:05 user nova-compute[82850]:     </system>
Apr 12 07:40:05 user nova-compute[82850]:   </sysinfo>
Apr 12 07:40:05 user nova-compute[82850]:   <os>
Apr 12 07:40:05 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:40:05 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:40:05 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:40:05 user nova-compute[82850]:   </os>
Apr 12 07:40:05 user nova-compute[82850]:   <features>
Apr 12 07:40:05 user nova-compute[82850]:     <acpi/>
Apr 12 07:40:05 user nova-compute[82850]:     <apic/>
Apr 12 07:40:05 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:40:05 user nova-compute[82850]:   </features>
Apr 12 07:40:05 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:40:05 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:40:05 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:40:05 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:40:05 user nova-compute[82850]:   </clock>
Apr 12 07:40:05 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:40:05 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:40:05 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:40:05 user nova-compute[82850]:   </cpu>
Apr 12 07:40:05 user nova-compute[82850]:   <devices>
Apr 12 07:40:05 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:40:05 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:40:05 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk"/>
Apr 12 07:40:05 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:40:05 user nova-compute[82850]:     </disk>
Apr 12 07:40:05 user nova-compute[82850]:     <disk type="file" device="cdrom">
Apr 12 07:40:05 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 07:40:05 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config"/>
Apr 12 07:40:05 user nova-compute[82850]:       <target dev="hda" bus="ide"/>
Apr 12 07:40:05 user nova-compute[82850]:     </disk>
Apr 12 07:40:05 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:05 user nova-compute[82850]:       <mac address="fa:16:3e:e2:ee:72"/>
Apr 12 07:40:05 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:05 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:05 user nova-compute[82850]:       <target dev="tap49ee8142-11"/>
Apr 12 07:40:05 user nova-compute[82850]:     </interface>
Apr 12 07:40:05 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:40:05 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log" append="off"/>
Apr 12 07:40:05 user nova-compute[82850]:     </serial>
Apr 12 07:40:05 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:40:05 user nova-compute[82850]:     <video>
Apr 12 07:40:05 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:05 user nova-compute[82850]:     </video>
Apr 12 07:40:05 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:40:05 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:40:05 user nova-compute[82850]:     </rng>
Apr 12 07:40:05 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:40:05 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:40:05 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:40:05 user nova-compute[82850]:     </memballoon>
Apr 12 07:40:05 user nova-compute[82850]:   </devices>
Apr 12 07:40:05 user nova-compute[82850]: </domain>
Apr 12 07:40:05 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG os_vif [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Successfully created port: 0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49ee8142-11, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49ee8142-11, col_values=(('external_ids', {'iface-id': '49ee8142-11f3-45a6-8a4d-be1968aa1ca1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ee:72', 'vm-uuid': '62827796-517b-46bd-acb2-98247fa081f4'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:05 user nova-compute[82850]: INFO os_vif [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11')
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name hda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No VIF found with MAC fa:16:3e:e2:ee:72, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:40:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Using config drive
Apr 12 07:40:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Creating config drive at /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzckpq655 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzckpq655" returned: 0 in 0.059s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Successfully updated port: 0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquired lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-changed-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Refreshing instance network info cache due to event network-changed-0685968d-8af1-412f-8755-27d88ae32314. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Acquiring lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] No waiting events found dispatching network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:06 user nova-compute[82850]: WARNING nova.compute.manager [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received unexpected event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 for instance with vm_state building and task_state spawning.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updating instance_info_cache with network_info: [{"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285207.0491693, d4f9729d-3114-4fc6-a704-02f436c17614 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] VM Resumed (Lifecycle Event)
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Releasing lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Instance network_info: |[{"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Acquired lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.neutron [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Refreshing network info cache for port 0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Start _get_guest_xml network_info=[{"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:39:54Z,direct_url=<?>,disk_format='qcow2',id=e37a17a0-55cd-4c56-a320-ff10e65f48f7,min_disk=0,min_ram=0,name='',owner='21e814a696534d8fb370b7b7fa73f73d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:39:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_name': '/dev/sda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': 'e37a17a0-55cd-4c56-a320-ff10e65f48f7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Instance spawned successfully.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:39:54Z,direct_url=<?>,disk_format='qcow2',id=e37a17a0-55cd-4c56-a320-ff10e65f48f7,min_disk=0,min_ram=0,name='',owner='21e814a696534d8fb370b7b7fa73f73d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:39:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-977931869',display_name='tempest-AttachSCSIVolumeTestJSON-server-977931869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-977931869',id=11,image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGwHDucxhfjXyaWw5D2kxH8A4L6D9HQliW9y3ojju8EU9ZXEg3SpzTGASkavRgR8pe9xIAbGFPQVL37SmYxaD49MN9pk/kPq0XfH/d08Jmy/UlGf4WQY+n1rtDufliS0w==',key_name='tempest-keypair-1375571147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a7b4669bf684bdaa24332f6821c7186',ramdisk_id='',reservation_id='r-hi1t4kqp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20787824',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20787824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1945c498db466dba6c16af19ff42d0',uuid=76db9cd6-5ebe-4e71-bbda-5734ed2dbc53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converting VIF {"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'pci_devices' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285207.0495424, d4f9729d-3114-4fc6-a704-02f436c17614 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] VM Started (Lifecycle Event)
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:40:07 user nova-compute[82850]:   <uuid>76db9cd6-5ebe-4e71-bbda-5734ed2dbc53</uuid>
Apr 12 07:40:07 user nova-compute[82850]:   <name>instance-0000000b</name>
Apr 12 07:40:07 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:40:07 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:40:07 user nova-compute[82850]:   <metadata>
Apr 12 07:40:07 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:40:07 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-977931869</nova:name>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:40:07</nova:creationTime>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:40:07 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:40:07 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:owner>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:user uuid="4a1945c498db466dba6c16af19ff42d0">tempest-AttachSCSIVolumeTestJSON-20787824-project-member</nova:user>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:project uuid="9a7b4669bf684bdaa24332f6821c7186">tempest-AttachSCSIVolumeTestJSON-20787824</nova:project>
Apr 12 07:40:07 user nova-compute[82850]:       </nova:owner>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:root type="image" uuid="e37a17a0-55cd-4c56-a320-ff10e65f48f7"/>
Apr 12 07:40:07 user nova-compute[82850]:       <nova:ports>
Apr 12 07:40:07 user nova-compute[82850]:         <nova:port uuid="0685968d-8af1-412f-8755-27d88ae32314">
Apr 12 07:40:07 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 07:40:07 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:07 user nova-compute[82850]:       </nova:ports>
Apr 12 07:40:07 user nova-compute[82850]:     </nova:instance>
Apr 12 07:40:07 user nova-compute[82850]:   </metadata>
Apr 12 07:40:07 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:40:07 user nova-compute[82850]:     <system>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="serial">76db9cd6-5ebe-4e71-bbda-5734ed2dbc53</entry>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="uuid">76db9cd6-5ebe-4e71-bbda-5734ed2dbc53</entry>
Apr 12 07:40:07 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:40:07 user nova-compute[82850]:     </system>
Apr 12 07:40:07 user nova-compute[82850]:   </sysinfo>
Apr 12 07:40:07 user nova-compute[82850]:   <os>
Apr 12 07:40:07 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:40:07 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:40:07 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:40:07 user nova-compute[82850]:   </os>
Apr 12 07:40:07 user nova-compute[82850]:   <features>
Apr 12 07:40:07 user nova-compute[82850]:     <acpi/>
Apr 12 07:40:07 user nova-compute[82850]:     <apic/>
Apr 12 07:40:07 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:40:07 user nova-compute[82850]:   </features>
Apr 12 07:40:07 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:40:07 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:40:07 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:40:07 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:40:07 user nova-compute[82850]:   </clock>
Apr 12 07:40:07 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:40:07 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:40:07 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:40:07 user nova-compute[82850]:   </cpu>
Apr 12 07:40:07 user nova-compute[82850]:   <devices>
Apr 12 07:40:07 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:40:07 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:40:07 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk"/>
Apr 12 07:40:07 user nova-compute[82850]:       <target dev="sda" bus="scsi"/>
Apr 12 07:40:07 user nova-compute[82850]:       <address type="drive" controller="0" unit="0"/>
Apr 12 07:40:07 user nova-compute[82850]:     </disk>
Apr 12 07:40:07 user nova-compute[82850]:     <disk type="file" device="cdrom">
Apr 12 07:40:07 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 07:40:07 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.config"/>
Apr 12 07:40:07 user nova-compute[82850]:       <target dev="sdb" bus="scsi"/>
Apr 12 07:40:07 user nova-compute[82850]:       <address type="drive" controller="0" unit="1"/>
Apr 12 07:40:07 user nova-compute[82850]:     </disk>
Apr 12 07:40:07 user nova-compute[82850]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 07:40:07 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:07 user nova-compute[82850]:       <mac address="fa:16:3e:10:67:27"/>
Apr 12 07:40:07 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:07 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:07 user nova-compute[82850]:       <target dev="tap0685968d-8a"/>
Apr 12 07:40:07 user nova-compute[82850]:     </interface>
Apr 12 07:40:07 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:40:07 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/console.log" append="off"/>
Apr 12 07:40:07 user nova-compute[82850]:     </serial>
Apr 12 07:40:07 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:40:07 user nova-compute[82850]:     <video>
Apr 12 07:40:07 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:07 user nova-compute[82850]:     </video>
Apr 12 07:40:07 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:40:07 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:40:07 user nova-compute[82850]:     </rng>
Apr 12 07:40:07 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:40:07 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:40:07 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:40:07 user nova-compute[82850]:     </memballoon>
Apr 12 07:40:07 user nova-compute[82850]:   </devices>
Apr 12 07:40:07 user nova-compute[82850]: </domain>
Apr 12 07:40:07 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-977931869',display_name='tempest-AttachSCSIVolumeTestJSON-server-977931869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-977931869',id=11,image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGwHDucxhfjXyaWw5D2kxH8A4L6D9HQliW9y3ojju8EU9ZXEg3SpzTGASkavRgR8pe9xIAbGFPQVL37SmYxaD49MN9pk/kPq0XfH/d08Jmy/UlGf4WQY+n1rtDufliS0w==',key_name='tempest-keypair-1375571147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a7b4669bf684bdaa24332f6821c7186',ramdisk_id='',reservation_id='r-hi1t4kqp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20787824',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20787824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1945c498db466dba6c16af19ff42d0',uuid=76db9cd6-5ebe-4e71-bbda-5734ed2dbc53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converting VIF {"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG os_vif [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0685968d-8a, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0685968d-8a, col_values=(('external_ids', {'iface-id': '0685968d-8af1-412f-8755-27d88ae32314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:67:27', 'vm-uuid': '76db9cd6-5ebe-4e71-bbda-5734ed2dbc53'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: INFO os_vif [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a')
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Took 6.73 seconds to spawn the instance on the hypervisor.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No BDM found with device name sda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No VIF found with MAC fa:16:3e:10:67:27, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Using config drive
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.compute.manager [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Took 7.76 seconds to build instance.
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.919s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Creating config drive at /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.config
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa9_x8clg {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa9_x8clg" returned: 0 in 0.064s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.neutron [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updated VIF entry in instance network info cache for port 0685968d-8af1-412f-8755-27d88ae32314. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.network.neutron [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updating instance_info_cache with network_info: [{"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Releasing lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:07 user nova-compute[82850]: WARNING nova.compute.manager [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance with vm_state building and task_state spawning.
Apr 12 07:40:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:09 user nova-compute[82850]: WARNING nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance with vm_state building and task_state spawning.
Apr 12 07:40:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] No waiting events found dispatching network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:09 user nova-compute[82850]: WARNING nova.compute.manager [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received unexpected event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 for instance with vm_state building and task_state spawning.
Apr 12 07:40:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:40:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285211.2428842, 62827796-517b-46bd-acb2-98247fa081f4 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] VM Resumed (Lifecycle Event)
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance spawned successfully.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285211.2432373, 62827796-517b-46bd-acb2-98247fa081f4 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] VM Started (Lifecycle Event)
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Took 9.80 seconds to spawn the instance on the hypervisor.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Took 11.00 seconds to build instance.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.251s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285211.7516341, 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] VM Resumed (Lifecycle Event)
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Instance spawned successfully.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] No waiting events found dispatching network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:11 user nova-compute[82850]: WARNING nova.compute.manager [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received unexpected event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 for instance with vm_state building and task_state spawning.
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285211.7533073, 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] VM Started (Lifecycle Event)
Apr 12 07:40:11 user nova-compute[82850]: INFO nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Took 8.64 seconds to spawn the instance on the hypervisor.
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:40:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:40:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: INFO nova.compute.manager [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Took 9.85 seconds to build instance.
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.101s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7404MB free_disk=26.47714614868164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance eee310e4-bed8-405f-bfc6-a6bc3085293d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f40c85d-313c-4485-8131-37d4c53441d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 62827796-517b-46bd-acb2-98247fa081f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:40:16 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:40:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.530s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:40:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updating instance_info_cache with network_info: [{"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-4f40c85d-313c-4485-8131-37d4c53441d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:40:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:40:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:40:33 user nova-compute[82850]: INFO nova.compute.claims [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Claim successful on node user
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:40:34 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:40:34 user nova-compute[82850]: INFO nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Booting with volume 642e1f33-fca6-4bcd-8c1e-74088387ef60 at /dev/vda
Apr 12 07:40:34 user nova-compute[82850]: DEBUG nova.policy [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:40:34 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:34 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpds1mc0ee/privsep.sock']
Apr 12 07:40:34 user sudo[93532]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpds1mc0ee/privsep.sock
Apr 12 07:40:34 user sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 07:40:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully created port: b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully created port: 75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:36 user sudo[93532]: pam_unix(sudo:session): session closed for user root
Apr 12 07:40:36 user nova-compute[82850]: INFO oslo.privsep.daemon [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Spawned new privsep daemon via rootwrap
Apr 12 07:40:36 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 07:40:36 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 07:40:36 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 07:40:36 user nova-compute[82850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93535
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aceea9a-b2ca-4323-8e8d-35885b94bb63]: (2,) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fdace2-f98b-40e1-b632-bc4e7028529f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: WARNING os_brick.initiator.connectors.nvmeof [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34a62ed-840f-4957-a7bd-3caa89481a8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully created port: 686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63283c31-e778-44a7-8f79-92b28ea6d210]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbfe1a-db3f-4a1f-9388-46edbbaf7f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:36 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:40:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e74cf-7bc5-4ac0-976f-294cb5da8963]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== get_connector_properties: return (2123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:36 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating existing volume attachment record: 8596e468-bd93-4545-9931-aa2248e30ad0 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:40:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully created port: 9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully created port: d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-b1942edc-4ba6-4b7f-b375-cfc4429e61e1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:39 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: 2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-2817bde8-a488-48b9-a877-32abe9e58c2b. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port 2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:41 user nova-compute[82850]: INFO nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Booting with volume 8d9e2b9f-1085-4d1c-9637-d640e3136de3 at /dev/vdb
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: 7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f241cf2a-7355-41e9-8e0b-695c7c9735bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057b3ad-baa2-4426-ad0a-1034c8958050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a92a5-f45c-4897-92e8-851c8debefea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[703230c7-6c8f-4cd4-ac9c-95b267832c43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:41 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d910161-274f-4d5d-a882-24dc5f00645f]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating existing volume attachment record: 7be096b8-f5f0-436b-a9f5-8861c75ee992 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: 75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: 686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-7522065e-41bf-4026-a63d-998d70579447. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port 7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-75ebd090-5ce9-45a9-9eab-fd31dccfebb2. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port 75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: 9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-686e8d90-a1be-43bf-86d2-72830eb7f3b9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port 686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Successfully updated port: d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-9e64b3a6-89bf-4238-83c1-fb78e3554ce6. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:45 user nova-compute[82850]: INFO nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Booting with volume c8669056-e4c7-4a8d-89e3-55640deee369 at /dev/vdc
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba31af-c8eb-4e5e-bacb-2678c7587a44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd24d7-a532-4b91-86c4-ddaea9763489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f1f039-7089-41e6-83cd-be67b38dd71f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb1114-4d17-4d75-afc6-92e591770ecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:40:45 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:40:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e8238-d738-4acb-b128-bde3fafe71eb]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG os_brick.utils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:45 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating existing volume attachment record: 8a6d1b71-bc7e-4dce-97ff-01f6791350ea {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance network_info: |[{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port 9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updated VIF entry in instance network info cache for port 9e64b3a6-89bf-4238-83c1-fb78e3554ce6. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-d8c70afe-012b-434e-a992-d87aff92acfa. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:40:47 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:40:48 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updated VIF entry in instance network info cache for port d8c70afe-012b-434e-a992-d87aff92acfa. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:40:48 user nova-compute[82850]: DEBUG nova.network.neutron [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:40:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:40:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Creating image(s)
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Ensure instance console log exists: /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Start _get_guest_xml network_info=[{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKUzspYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23c2ab3f-ce38-434b-a879-91f43d16f730', 'attached_at': '', 'detached_at': '', 'volume_id': '642e1f33-fca6-4bcd-8c1e-74088387ef60', 'serial': '642e1f33-fca6-4bcd-8c1e-74088387ef60'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '8596e468-bd93-4545-9931-aa2248e30ad0', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDUHwBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23c2ab3f-ce38-434b-a879-91f43d16f730', 'attached_at': '', 'detached_at': '', 'volume_id': '8d9e2b9f-1085-4d1c-9637-d640e3136de3', 'serial': '8d9e2b9f-1085-4d1c-9637-d640e3136de3'}, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '7be096b8-f5f0-436b-a9f5-8861c75ee992', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaPQxMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23c2ab3f-ce38-434b-a879-91f43d16f730', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8669056-e4c7-4a8d-89e3-55640deee369', 'serial': 'c8669056-e4c7-4a8d-89e3-55640deee369'}, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '8a6d1b71-bc7e-4dce-97ff-01f6791350ea', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:40:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connector [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Factory for ISCSI on None {{(pid=82850) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKUzspYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:50 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:50 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:50 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ccd5c-9ac9-45ae-9f24-cf3d6c645150]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:40:50 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ecc96a-8e59-4b92-bb53-04ffab188a98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60] added
Apr 12 07:40:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1ba4a3-ce38-45d7-ae81-8d30d6fddfde]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a60ba-1883-4d46-bb0d-2912c09827ef]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKUzspYc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKUzspYc" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e021827-a5c2-41f1-bce3-fbc795c0df4a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKUzspYc'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefce19d-63bf-49cf-8f99-3378b454c6f1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36809352-e5f1-4979-b109-634af0e8d22a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 07:40:50 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 07:40:50 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:50 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 07:40:50 user nova-compute[82850]: 
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[257bf5c3-eb8f-4cfb-adad-fcafe12e382b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260]
Apr 12 07:40:50 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260] successful.
Apr 12 07:40:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc46a900-132b-4f44-bea0-853e79201d1a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e67db-91d4-4912-ae8a-d7885c9f8369]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f60bc07-0ac1-46a7-95ee-d3500f738069]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:40:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKUzspYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26235386135373532', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235386135373532', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDUHwBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:51 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[106e6f6f-f42f-4da6-8f9f-5d9070cec84d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:40:51 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a26f95-c332-4c81-8971-61034bd4babd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3] added
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708c360-e21a-448d-aaf1-27e18d4f6c23]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ba774-adb8-437a-8a26-e61fdb389f53]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDUHwBhW {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDUHwBhW" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e913801b-615d-4bc6-a4ed-d07aa5f02395]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fDUHwBhW'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a89552-3f70-4d8e-b1dd-ee0ee86a3603]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc935de-996a-4f9f-8ed4-dd1d803c3ba4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d49242-c79b-4c58-93ef-0f2b40bf81ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260]
Apr 12 07:40:51 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260] successful.
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06854a3a-49cb-48b9-baf6-8e8d96ccccdf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3baac-d4a1-4f91-98fe-0217510791fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee1341-e71d-49d7-a154-b2e8e37271d1]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:40:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDUHwBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26563363739656437', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563363739656437', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaPQxMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:40:52 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:52 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:40:52 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:40:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3bc7b-c23b-4b9f-a447-a9e3b18bc95a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:40:52 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500e854-e93c-471a-bcc3-280771ca5565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369] added
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aed6e5-5790-462d-98f2-4c26e562538e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0502bac2-df68-4b61-bbf6-1b360c1d549a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaPQxMum {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaPQxMum" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6f80a-88d7-4cfb-b4e5-bd46abbe492f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FaPQxMum'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d033e35-a714-48b6-8e3a-e965d266e1e9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d0cc61-71e6-4c7b-962c-dad14ee3d957]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[756abc8e-3d5d-4df3-93ef-cfc155fa5575]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260]
Apr 12 07:40:53 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260] successful.
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7f0b6-a820-4d42-bea8-15f49d0b7a8f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9910ede4-240b-40dc-a5a6-283aa87949c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:40:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb734565-919c-4c87-94fd-37ad7ecf4518]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:40:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaPQxMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23061316634343339', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061316634343339', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lazy-loading 'pci_devices' on Instance uuid 23c2ab3f-ce38-434b-a879-91f43d16f730 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:40:54 user nova-compute[82850]:   <uuid>23c2ab3f-ce38-434b-a879-91f43d16f730</uuid>
Apr 12 07:40:54 user nova-compute[82850]:   <name>instance-0000000c</name>
Apr 12 07:40:54 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:40:54 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:40:54 user nova-compute[82850]:   <metadata>
Apr 12 07:40:54 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:40:54 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:name>tempest-device-tagging-server-30542415</nova:name>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:40:50</nova:creationTime>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:40:54 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:40:54 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:owner>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:user uuid="b74586fa38f44010878c70a8e60395ae">tempest-TaggedBootDevicesTest_v242-1306806466-project-member</nova:user>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:project uuid="7a14e30be0d8491a915bb08ed9d296ce">tempest-TaggedBootDevicesTest_v242-1306806466</nova:project>
Apr 12 07:40:54 user nova-compute[82850]:       </nova:owner>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:40:54 user nova-compute[82850]:       <nova:ports>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="b1942edc-4ba6-4b7f-b375-cfc4429e61e1">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="2817bde8-a488-48b9-a877-32abe9e58c2b">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="7522065e-41bf-4026-a63d-998d70579447">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="75ebd090-5ce9-45a9-9eab-fd31dccfebb2">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="686e8d90-a1be-43bf-86d2-72830eb7f3b9">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="9e64b3a6-89bf-4238-83c1-fb78e3554ce6">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:         <nova:port uuid="d8c70afe-012b-434e-a992-d87aff92acfa">
Apr 12 07:40:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 07:40:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:40:54 user nova-compute[82850]:       </nova:ports>
Apr 12 07:40:54 user nova-compute[82850]:     </nova:instance>
Apr 12 07:40:54 user nova-compute[82850]:   </metadata>
Apr 12 07:40:54 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:40:54 user nova-compute[82850]:     <system>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="serial">23c2ab3f-ce38-434b-a879-91f43d16f730</entry>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="uuid">23c2ab3f-ce38-434b-a879-91f43d16f730</entry>
Apr 12 07:40:54 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:40:54 user nova-compute[82850]:     </system>
Apr 12 07:40:54 user nova-compute[82850]:   </sysinfo>
Apr 12 07:40:54 user nova-compute[82850]:   <os>
Apr 12 07:40:54 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:40:54 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:40:54 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:40:54 user nova-compute[82850]:   </os>
Apr 12 07:40:54 user nova-compute[82850]:   <features>
Apr 12 07:40:54 user nova-compute[82850]:     <acpi/>
Apr 12 07:40:54 user nova-compute[82850]:     <apic/>
Apr 12 07:40:54 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:40:54 user nova-compute[82850]:   </features>
Apr 12 07:40:54 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:40:54 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:40:54 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:40:54 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:40:54 user nova-compute[82850]:   </clock>
Apr 12 07:40:54 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:40:54 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:40:54 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:40:54 user nova-compute[82850]:   </cpu>
Apr 12 07:40:54 user nova-compute[82850]:   <devices>
Apr 12 07:40:54 user nova-compute[82850]:     <disk type="file" device="cdrom">
Apr 12 07:40:54 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 07:40:54 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/disk.config"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="hda" bus="ide"/>
Apr 12 07:40:54 user nova-compute[82850]:     </disk>
Apr 12 07:40:54 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:40:54 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:40:54 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <serial>642e1f33-fca6-4bcd-8c1e-74088387ef60</serial>
Apr 12 07:40:54 user nova-compute[82850]:     </disk>
Apr 12 07:40:54 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:40:54 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:40:54 user nova-compute[82850]:       <source dev="/dev/sdc"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <serial>8d9e2b9f-1085-4d1c-9637-d640e3136de3</serial>
Apr 12 07:40:54 user nova-compute[82850]:     </disk>
Apr 12 07:40:54 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:40:54 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:40:54 user nova-compute[82850]:       <source dev="/dev/sdd"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="vdc" bus="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <serial>c8669056-e4c7-4a8d-89e3-55640deee369</serial>
Apr 12 07:40:54 user nova-compute[82850]:     </disk>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:b7:d7:f7"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tapb1942edc-4b"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:9e:31:9b"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tap2817bde8-a4"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:d3:27:14"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tap7522065e-41"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:c9:34:37"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tap75ebd090-5c"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:59:41:de"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tap686e8d90-a1"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:60:5f:db"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tap9e64b3a6-89"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:40:54 user nova-compute[82850]:       <mac address="fa:16:3e:06:90:3c"/>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:40:54 user nova-compute[82850]:       <target dev="tapd8c70afe-01"/>
Apr 12 07:40:54 user nova-compute[82850]:     </interface>
Apr 12 07:40:54 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:40:54 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/console.log" append="off"/>
Apr 12 07:40:54 user nova-compute[82850]:     </serial>
Apr 12 07:40:54 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:40:54 user nova-compute[82850]:     <video>
Apr 12 07:40:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:40:54 user nova-compute[82850]:     </video>
Apr 12 07:40:54 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:40:54 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:40:54 user nova-compute[82850]:     </rng>
Apr 12 07:40:54 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:40:54 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:40:54 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:40:54 user nova-compute[82850]:     </memballoon>
Apr 12 07:40:54 user nova-compute[82850]:   </devices>
Apr 12 07:40:54 user nova-compute[82850]: </domain>
Apr 12 07:40:54 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1942edc-4b, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1942edc-4b, col_values=(('external_ids', {'iface-id': 'b1942edc-4ba6-4b7f-b375-cfc4429e61e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d7:f7', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2817bde8-a4, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2817bde8-a4, col_values=(('external_ids', {'iface-id': '2817bde8-a488-48b9-a877-32abe9e58c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:31:9b', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7522065e-41, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7522065e-41, col_values=(('external_ids', {'iface-id': '7522065e-41bf-4026-a63d-998d70579447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:27:14', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75ebd090-5c, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75ebd090-5c, col_values=(('external_ids', {'iface-id': '75ebd090-5ce9-45a9-9eab-fd31dccfebb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:34:37', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap686e8d90-a1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap686e8d90-a1, col_values=(('external_ids', {'iface-id': '686e8d90-a1be-43bf-86d2-72830eb7f3b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:41:de', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e64b3a6-89, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e64b3a6-89, col_values=(('external_ids', {'iface-id': '9e64b3a6-89bf-4238-83c1-fb78e3554ce6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:5f:db', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c70afe-01, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c70afe-01, col_values=(('external_ids', {'iface-id': 'd8c70afe-012b-434e-a992-d87aff92acfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:90:3c', 'vm-uuid': '23c2ab3f-ce38-434b-a879-91f43d16f730'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:54 user nova-compute[82850]: INFO os_vif [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01')
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] No BDM found with device name hda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] No VIF found with MAC fa:16:3e:b7:d7:f7, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] No VIF found with MAC fa:16:3e:59:41:de, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:40:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Using config drive
Apr 12 07:40:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Creating config drive at /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/disk.config
Apr 12 07:40:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbe913s7t {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:40:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbe913s7t" returned: 0 in 0.065s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:40:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:56 user nova-compute[82850]: WARNING nova.compute.manager [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance with vm_state building and task_state spawning.
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:58 user nova-compute[82850]: WARNING nova.compute.manager [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance with vm_state building and task_state spawning.
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:58 user nova-compute[82850]: WARNING nova.compute.manager [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:59 user nova-compute[82850]: WARNING nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:59 user nova-compute[82850]: WARNING nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:59 user nova-compute[82850]: WARNING nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:59 user nova-compute[82850]: WARNING nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:40:59 user nova-compute[82850]: WARNING nova.compute.manager [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 for instance with vm_state building and task_state spawning.
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:40:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:00 user nova-compute[82850]: WARNING nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance with vm_state building and task_state spawning.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:00 user nova-compute[82850]: WARNING nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance with vm_state building and task_state spawning.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:00 user nova-compute[82850]: WARNING nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance with vm_state building and task_state spawning.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:00 user nova-compute[82850]: WARNING nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance with vm_state building and task_state spawning.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:00 user nova-compute[82850]: WARNING nova.compute.manager [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance with vm_state building and task_state spawning.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285260.9744074, 23c2ab3f-ce38-434b-a879-91f43d16f730 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:00 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] VM Resumed (Lifecycle Event)
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:41:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance spawned successfully.
Apr 12 07:41:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:01 user nova-compute[82850]: WARNING nova.compute.manager [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa for instance with vm_state building and task_state spawning.
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285260.9793015, 23c2ab3f-ce38-434b-a879-91f43d16f730 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] VM Started (Lifecycle Event)
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:41:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Took 10.87 seconds to spawn the instance on the hypervisor.
Apr 12 07:41:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Took 27.68 seconds to build instance.
Apr 12 07:41:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.804s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lazy-loading 'flavor' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:07 user nova-compute[82850]: INFO nova.compute.manager [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Attaching volume 216d0338-4a75-49f0-96a4-7a7afd2a3176 to /dev/vdb
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.utils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b9d1f-c944-4790-b207-10b880b14edd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.048s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fdb80e-30bd-4387-a0a7-3cfa83cbb8c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.056s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1ddb6-4fe2-495f-abc4-4a3ea3cc533a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a86cc4-c47b-419d-9430-8ef7e290ffbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:07 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a43ae72-8797-4f13-88b7-491c1b78d8d5]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG os_brick.utils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:07 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updating existing volume attachment record: 94ffc487-786d-4f4d-9307-3dcbc8d4408c {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:09 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:41:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTFqVYDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:12 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[714e4574-99c7-4333-ba1e-2520ffd00cfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:12 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e60fc-4637-4548-8f15-c0fc88cb73cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176] added
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016355f-ea2b-42a1-9cbb-cc5fbe1091de]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fabc6-893d-4afe-be0e-9fb705674f17]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTFqVYDb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTFqVYDb" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc914c4-71aa-4b90-a32a-6b32e14f37df]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTFqVYDb'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402d1ed-8634-4638-bb11-1b1a208d4de6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453f6b6-0885-43fa-ad2a-8b74534a5cb2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f998b98-eb59-4add-b18b-2a51c485c261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260]
Apr 12 07:41:12 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[030081c1-95b9-4215-af3c-cd0867632196]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ee488-8246-4310-b103-060eddd3e604]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)
Apr 12 07:41:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e612b0-5d4c-47d0-8a84-1cf116173392]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTFqVYDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:41:12 user nova-compute[82850]: INFO nova.compute.claims [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Claim successful on node user
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.804s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26336316561373465', 'path': '/dev/sde'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336316561373465', 'path': '/dev/sde'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lazy-loading 'flavor' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:41:13 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:41:13 user nova-compute[82850]:   <source dev="/dev/sde"/>
Apr 12 07:41:13 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:41:13 user nova-compute[82850]:   <serial>216d0338-4a75-49f0-96a4-7a7afd2a3176</serial>
Apr 12 07:41:13 user nova-compute[82850]: </disk>
Apr 12 07:41:13 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:41:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Creating image(s)
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "/opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "/opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG nova.policy [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:41:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.167s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk 1073741824" returned: 0 in 0.051s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] No VIF found with MAC fa:16:3e:db:e0:27, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.163s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.139s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Cannot resize image /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.objects.instance [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'migration_context' on Instance uuid b71c5ba4-aeff-454c-a89c-0cef7ab13806 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Ensure instance console log exists: /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:15 user nova-compute[82850]: INFO nova.compute.manager [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Rescuing
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:15 user nova-compute[82850]: INFO nova.compute.manager [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Terminating instance
Apr 12 07:41:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Successfully created port: 0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-unplugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] No waiting events found dispatching network-vif-unplugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-unplugged-5b484c80-547c-43a2-8b8b-432bc559c1fc for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:41:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Instance destroyed successfully.
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lazy-loading 'resources' on Instance uuid 4f40c85d-313c-4485-8131-37d4c53441d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7093MB free_disk=26.39801788330078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-347260054',display_name='tempest-DeleteServersTestJSON-server-347260054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-347260054',id=1,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a1237d4763c436fbbeaf03fad8ee570',ramdisk_id='',reservation_id='r-zl0c9zwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1756098866',owner_user_name='tempest-DeleteServersTestJSON-1756098866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:39:33Z,user_data=None,user_id='b9da4c1fc6e54f7a8c780f9450b9f826',uuid=4f40c85d-313c-4485-8131-37d4c53441d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converting VIF {"id": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "address": "fa:16:3e:db:e0:27", "network": {"id": "4b28a8fe-8f70-45e5-90c6-5794f01e492a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-4154336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1237d4763c436fbbeaf03fad8ee570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b484c80-54", "ovs_interfaceid": "5b484c80-547c-43a2-8b8b-432bc559c1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_vif [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b484c80-54, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:16 user nova-compute[82850]: INFO os_vif [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:e0:27,bridge_name='br-int',has_traffic_filtering=True,id=5b484c80-547c-43a2-8b8b-432bc559c1fc,network=Network(4b28a8fe-8f70-45e5-90c6-5794f01e492a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b484c80-54')
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTFqVYDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:16 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcad2fd1-9398-47a7-9f70-4f3a11b76208]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:41:16 user nova-compute[82850]: No targets found.
Apr 12 07:41:16 user nova-compute[82850]: iSNS:
Apr 12 07:41:16 user nova-compute[82850]: No targets found.
Apr 12 07:41:16 user nova-compute[82850]: STATIC:
Apr 12 07:41:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:41:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:41:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:41:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:41:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:41:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:41:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176
Apr 12 07:41:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:41:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:41:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:41:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:41:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:41:16 user nova-compute[82850]: FIRMWARE:
Apr 12 07:41:16 user nova-compute[82850]: No targets found.
Apr 12 07:41:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:41:16 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:41:16 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb07e9a7-99d9-4536-9ea5-f9f6ab6fc01e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf5cd5-1541-41ca-890b-692d96e4c9ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 (non-flash)
Apr 12 07:41:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951e728c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176'): ({'sde'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Removing single pathed devices sde {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:41:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance eee310e4-bed8-405f-bfc6-a6bc3085293d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f40c85d-313c-4485-8131-37d4c53441d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 62827796-517b-46bd-acb2-98247fa081f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39746ac-b829-47b0-951c-1f71a62aaa2c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b9258-6b87-419d-b8fc-35eb5225d79e]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Flushing IO for device /dev/sde {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c469551-8401-42bb-88c7-8e8542f244a8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0cbcc7-14ec-493c-aa3a-9df18486516f]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c6bec-96a3-4696-bcc8-c5bf163ab142]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec1e3a-c51c-4006-a1a6-d661ced50b47]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260]
Apr 12 07:41:17 user nova-compute[82850]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:17 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216d0338-4a75-49f0-96a4-7a7afd2a3176 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8185a2-49ee-4ad7-bad5-65fad8f7e091]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] <== disconnect_volume: return (392ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Deleting instance files /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7_del
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Deletion of /opt/stack/data/nova/instances/4f40c85d-313c-4485-8131-37d4c53441d7_del complete
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82850) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.host [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] UEFI support detected
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.compute.manager [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Took 1.99 seconds to destroy the instance on the hypervisor.
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.804s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance destroyed successfully.
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Attempting rescue
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:41:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Creating image(s)
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'trusted_certs' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.172s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Successfully updated port: 0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue" returned: 0 in 0.068s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquired lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start _get_guest_xml network_info=[{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:6c:18:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-changed-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Refreshing instance network info cache due to event network-changed-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Acquiring lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'numa_topology' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:18 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:18 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'vcpu_model' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377191038',display_name='tempest-ServerRescueNegativeTestJSON-server-377191038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377191038',id=5,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-1nh4kdns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:42Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=acbd6126-210b-41cf-a994-528233e5369b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:6c:18:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:6c:18:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquiring lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "4f40c85d-313c-4485-8131-37d4c53441d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] No waiting events found dispatching network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:18 user nova-compute[82850]: WARNING nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received unexpected event network-vif-plugged-5b484c80-547c-43a2-8b8b-432bc559c1fc for instance with vm_state active and task_state deleting.
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-changed-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Refreshing instance network info cache due to event network-changed-d24db70b-543b-4549-8c33-b8276a776c3d. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Refreshing network info cache for port d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:41:18 user nova-compute[82850]:   <uuid>acbd6126-210b-41cf-a994-528233e5369b</uuid>
Apr 12 07:41:18 user nova-compute[82850]:   <name>instance-00000005</name>
Apr 12 07:41:18 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:41:18 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:41:18 user nova-compute[82850]:   <metadata>
Apr 12 07:41:18 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:41:18 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377191038</nova:name>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:41:18</nova:creationTime>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:41:18 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:41:18 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:owner>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:41:18 user nova-compute[82850]:       </nova:owner>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:41:18 user nova-compute[82850]:       <nova:ports>
Apr 12 07:41:18 user nova-compute[82850]:         <nova:port uuid="72eb7ca6-62de-4e4f-b40f-52343e160945">
Apr 12 07:41:18 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 07:41:18 user nova-compute[82850]:         </nova:port>
Apr 12 07:41:18 user nova-compute[82850]:       </nova:ports>
Apr 12 07:41:18 user nova-compute[82850]:     </nova:instance>
Apr 12 07:41:18 user nova-compute[82850]:   </metadata>
Apr 12 07:41:18 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:41:18 user nova-compute[82850]:     <system>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="serial">acbd6126-210b-41cf-a994-528233e5369b</entry>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="uuid">acbd6126-210b-41cf-a994-528233e5369b</entry>
Apr 12 07:41:18 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:41:18 user nova-compute[82850]:     </system>
Apr 12 07:41:18 user nova-compute[82850]:   </sysinfo>
Apr 12 07:41:18 user nova-compute[82850]:   <os>
Apr 12 07:41:18 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:41:18 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:41:18 user nova-compute[82850]:   </os>
Apr 12 07:41:18 user nova-compute[82850]:   <features>
Apr 12 07:41:18 user nova-compute[82850]:     <acpi/>
Apr 12 07:41:18 user nova-compute[82850]:     <apic/>
Apr 12 07:41:18 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:41:18 user nova-compute[82850]:   </features>
Apr 12 07:41:18 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:41:18 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:41:18 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:41:18 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:41:18 user nova-compute[82850]:   </clock>
Apr 12 07:41:18 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:41:18 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:41:18 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:41:18 user nova-compute[82850]:   </cpu>
Apr 12 07:41:18 user nova-compute[82850]:   <devices>
Apr 12 07:41:18 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:41:18 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:41:18 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue"/>
Apr 12 07:41:18 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:41:18 user nova-compute[82850]:     </disk>
Apr 12 07:41:18 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:41:18 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:41:18 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk"/>
Apr 12 07:41:18 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:41:18 user nova-compute[82850]:     </disk>
Apr 12 07:41:18 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:41:18 user nova-compute[82850]:       <mac address="fa:16:3e:6c:18:60"/>
Apr 12 07:41:18 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:18 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:41:18 user nova-compute[82850]:       <target dev="tap72eb7ca6-62"/>
Apr 12 07:41:18 user nova-compute[82850]:     </interface>
Apr 12 07:41:18 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:41:18 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/console.log" append="off"/>
Apr 12 07:41:18 user nova-compute[82850]:     </serial>
Apr 12 07:41:18 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:41:18 user nova-compute[82850]:     <video>
Apr 12 07:41:18 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:18 user nova-compute[82850]:     </video>
Apr 12 07:41:18 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:41:18 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:41:18 user nova-compute[82850]:     </rng>
Apr 12 07:41:18 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:41:18 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:41:18 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:41:18 user nova-compute[82850]:     </memballoon>
Apr 12 07:41:18 user nova-compute[82850]:   </devices>
Apr 12 07:41:18 user nova-compute[82850]: </domain>
Apr 12 07:41:18 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:18 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Took 0.94 seconds to deallocate network for instance.
Apr 12 07:41:18 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance destroyed successfully.
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:6c:18:60, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updating instance_info_cache with network_info: [{"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:19 user nova-compute[82850]: INFO nova.compute.manager [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Took 0.93 seconds to detach 1 volumes for instance.
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-e21b1323-aafd-4989-92c0-3ba5b45ba2bc" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Updating instance_info_cache with network_info: [{"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Releasing lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Instance network_info: |[{"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Acquired lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Refreshing network info cache for port 0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Start _get_guest_xml network_info=[{"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-772784802',display_name='tempest-ServersNegativeTestJSON-server-772784802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-772784802',id=13,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-b04t55eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:14Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=b71c5ba4-aeff-454c-a89c-0cef7ab13806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.objects.instance [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'pci_devices' on Instance uuid b71c5ba4-aeff-454c-a89c-0cef7ab13806 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:41:19 user nova-compute[82850]:   <uuid>b71c5ba4-aeff-454c-a89c-0cef7ab13806</uuid>
Apr 12 07:41:19 user nova-compute[82850]:   <name>instance-0000000d</name>
Apr 12 07:41:19 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:41:19 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:41:19 user nova-compute[82850]:   <metadata>
Apr 12 07:41:19 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:41:19 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:name>tempest-ServersNegativeTestJSON-server-772784802</nova:name>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:41:19</nova:creationTime>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:41:19 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:41:19 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:owner>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:user uuid="4b61df1643964059b70eba466af4b6db">tempest-ServersNegativeTestJSON-1126238824-project-member</nova:user>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:project uuid="2b1ea22b656f42ab9e8d117b0ff11b3a">tempest-ServersNegativeTestJSON-1126238824</nova:project>
Apr 12 07:41:19 user nova-compute[82850]:       </nova:owner>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:41:19 user nova-compute[82850]:       <nova:ports>
Apr 12 07:41:19 user nova-compute[82850]:         <nova:port uuid="0cb5bbd3-349d-4eac-834b-1bb7aeed5cee">
Apr 12 07:41:19 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 07:41:19 user nova-compute[82850]:         </nova:port>
Apr 12 07:41:19 user nova-compute[82850]:       </nova:ports>
Apr 12 07:41:19 user nova-compute[82850]:     </nova:instance>
Apr 12 07:41:19 user nova-compute[82850]:   </metadata>
Apr 12 07:41:19 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:41:19 user nova-compute[82850]:     <system>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="serial">b71c5ba4-aeff-454c-a89c-0cef7ab13806</entry>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="uuid">b71c5ba4-aeff-454c-a89c-0cef7ab13806</entry>
Apr 12 07:41:19 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:41:19 user nova-compute[82850]:     </system>
Apr 12 07:41:19 user nova-compute[82850]:   </sysinfo>
Apr 12 07:41:19 user nova-compute[82850]:   <os>
Apr 12 07:41:19 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:41:19 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:41:19 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:41:19 user nova-compute[82850]:   </os>
Apr 12 07:41:19 user nova-compute[82850]:   <features>
Apr 12 07:41:19 user nova-compute[82850]:     <acpi/>
Apr 12 07:41:19 user nova-compute[82850]:     <apic/>
Apr 12 07:41:19 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:41:19 user nova-compute[82850]:   </features>
Apr 12 07:41:19 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:41:19 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:41:19 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:41:19 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:41:19 user nova-compute[82850]:   </clock>
Apr 12 07:41:19 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:41:19 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:41:19 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:41:19 user nova-compute[82850]:   </cpu>
Apr 12 07:41:19 user nova-compute[82850]:   <devices>
Apr 12 07:41:19 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:41:19 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:41:19 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk"/>
Apr 12 07:41:19 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:41:19 user nova-compute[82850]:     </disk>
Apr 12 07:41:19 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:41:19 user nova-compute[82850]:       <mac address="fa:16:3e:90:ea:59"/>
Apr 12 07:41:19 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:19 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:41:19 user nova-compute[82850]:       <target dev="tap0cb5bbd3-34"/>
Apr 12 07:41:19 user nova-compute[82850]:     </interface>
Apr 12 07:41:19 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:41:19 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/console.log" append="off"/>
Apr 12 07:41:19 user nova-compute[82850]:     </serial>
Apr 12 07:41:19 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:41:19 user nova-compute[82850]:     <video>
Apr 12 07:41:19 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:19 user nova-compute[82850]:     </video>
Apr 12 07:41:19 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:41:19 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:41:19 user nova-compute[82850]:     </rng>
Apr 12 07:41:19 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:41:19 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:41:19 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:41:19 user nova-compute[82850]:     </memballoon>
Apr 12 07:41:19 user nova-compute[82850]:   </devices>
Apr 12 07:41:19 user nova-compute[82850]: </domain>
Apr 12 07:41:19 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-772784802',display_name='tempest-ServersNegativeTestJSON-server-772784802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-772784802',id=13,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-b04t55eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:14Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=b71c5ba4-aeff-454c-a89c-0cef7ab13806,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG os_vif [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cb5bbd3-34, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cb5bbd3-34, col_values=(('external_ids', {'iface-id': '0cb5bbd3-349d-4eac-834b-1bb7aeed5cee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ea:59', 'vm-uuid': 'b71c5ba4-aeff-454c-a89c-0cef7ab13806'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: INFO os_vif [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34')
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] No VIF found with MAC fa:16:3e:90:ea:59, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updated VIF entry in instance network info cache for port d24db70b-543b-4549-8c33-b8276a776c3d. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:19 user nova-compute[82850]: WARNING nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state active and task_state rescuing.
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:19 user nova-compute[82850]: WARNING nova.compute.manager [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state active and task_state rescuing.
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:20 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Deleted allocations for instance 4f40c85d-313c-4485-8131-37d4c53441d7
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Updated VIF entry in instance network info cache for port 0cb5bbd3-349d-4eac-834b-1bb7aeed5cee. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Updating instance_info_cache with network_info: [{"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Releasing lock "refresh_cache-b71c5ba4-aeff-454c-a89c-0cef7ab13806" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "4f40c85d-313c-4485-8131-37d4c53441d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.798s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Received event network-vif-deleted-5b484c80-547c-43a2-8b8b-432bc559c1fc {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-changed-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Refreshing instance network info cache due to event network-changed-40ca8897-7180-4ef1-91f2-29b18afbcc25. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Refreshing network info cache for port 40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:21 user nova-compute[82850]: INFO nova.compute.manager [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Attaching volume d264d7ac-e4d5-48b7-b5f8-11b463caef9f to /dev/vdb
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.utils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[065126ba-517c-47fe-81f8-889bc8511392]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e36c6b1-9157-4b29-a396-4b812d8435ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[659dfdce-a0f5-4dc4-80ef-3c92b66ffe8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c17156-b08e-44ea-b7c9-0160fcd897cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:21 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f66caa-dfde-4e99-b180-e8c8cf86108b]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG os_brick.utils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating existing volume attachment record: 6f484932-d722-4989-94e4-e62e73007481 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updated VIF entry in instance network info cache for port 40ca8897-7180-4ef1-91f2-29b18afbcc25. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:22 user nova-compute[82850]: WARNING nova.compute.manager [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state active and task_state rescuing.
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] No waiting events found dispatching network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:22 user nova-compute[82850]: WARNING nova.compute.manager [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received unexpected event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance with vm_state building and task_state spawning.
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing instance network info cache due to event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:22 user nova-compute[82850]: WARNING nova.compute.manager [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state active and task_state rescuing.
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updated VIF entry in instance network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.compute.manager [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] instance snapshotting
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Beginning live snapshot process
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for acbd6126-210b-41cf-a994-528233e5369b due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285283.9079058, acbd6126-210b-41cf-a994-528233e5369b => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] VM Resumed (Lifecycle Event)
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Instance spawned successfully.
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 07:41:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285283.9088943, acbd6126-210b-41cf-a994-528233e5369b => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] VM Started (Lifecycle Event)
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.claims [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Claim successful on node user
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285283.9147854, b71c5ba4-aeff-454c-a89c-0cef7ab13806 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] VM Resumed (Lifecycle Event)
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.218s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c.delta 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Took 10.38 seconds to spawn the instance on the hypervisor.
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c.delta 1073741824" returned: 0 in 0.110s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285283.9177504, b71c5ba4-aeff-454c-a89c-0cef7ab13806 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] VM Started (Lifecycle Event)
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] No waiting events found dispatching network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:24 user nova-compute[82850]: WARNING nova.compute.manager [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received unexpected event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance with vm_state building and task_state spawning.
Apr 12 07:41:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:24 user nova-compute[82850]: INFO nova.compute.manager [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Took 11.72 seconds to build instance.
Apr 12 07:41:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.859s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.955s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:41:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:25 user nova-compute[82850]: INFO nova.virt.block_device [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Booting with volume snapshot 66df63d5-6afc-456b-8e87-bfb37e26aeeb at /dev/vda
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.policy [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:41:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 07:41:26 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:41:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c.delta /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c.delta /opt/stack/data/nova/instances/snapshots/tmpuxz6o6sq/52b487dddae74e5bb91c474673cb518c" returned: 0 in 0.518s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Snapshot extracted, beginning image upload
Apr 12 07:41:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Successfully created port: 9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:41:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:27 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:27 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:27 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fbb1aa-b8c1-4bd5-8880-ce894999a0fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:27 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abec6d8-53a1-40d2-ad06-e89c1630a32a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f] added
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cb1a4-7198-4e24-84f8-f7a3d3919e0a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[184cbecc-4390-41e4-a142-77cb5aa91622]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrqzIwHE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrqzIwHE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9daa811-0275-464e-8b96-af4fd5493346]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrqzIwHE'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61ba7e-9ad9-4845-9b9b-5a72763e4bb9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad28398-3968-42f5-b43d-696f8e432525]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[329e746c-d1fa-4c8d-9b37-9066aa3767b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]
Apr 12 07:41:27 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a300549-7499-42cf-9624-650a3576c6ce]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb55830a-8457-4318-99d4-3a24b304e43f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:27 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf0d43-46f5-4ed7-8479-08d8238e6fc6]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Successfully updated port: 9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-changed-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Refreshing instance network info cache due to event network-changed-9e37061f-71da-4cdf-b22b-814cda161f85. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Acquiring lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Updating instance_info_cache with network_info: [{"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Instance network_info: |[{"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Acquired lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Refreshing network info cache for port 9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26436323238633838', 'path': '/dev/sde'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436323238633838', 'path': '/dev/sde'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:41:28 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:41:28 user nova-compute[82850]:   <source dev="/dev/sde"/>
Apr 12 07:41:28 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:41:28 user nova-compute[82850]:   <serial>d264d7ac-e4d5-48b7-b5f8-11b463caef9f</serial>
Apr 12 07:41:28 user nova-compute[82850]: </disk>
Apr 12 07:41:28 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Updated VIF entry in instance network info cache for port 9e37061f-71da-4cdf-b22b-814cda161f85. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Updating instance_info_cache with network_info: [{"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Releasing lock "refresh_cache-98cb3965-b028-474d-90b3-b8c6f33b62a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No VIF found with MAC fa:16:3e:b7:ec:08, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.113s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Snapshot image upload complete
Apr 12 07:41:29 user nova-compute[82850]: INFO nova.compute.manager [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Took 6.01 seconds to snapshot the instance on the hypervisor.
Apr 12 07:41:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82850) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:30 user nova-compute[82850]: WARNING nova.compute.manager [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state active and task_state powering-off.
Apr 12 07:41:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance destroyed successfully.
Apr 12 07:41:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.894s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.utils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd0563-abb1-4242-a2e9-30362fd3745f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285276.2401247, 4f40c85d-313c-4485-8131-37d4c53441d7 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:31 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] VM Stopped (Lifecycle Event)
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[542172e7-d1fc-4eb6-be29-b31d53ef952e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2be42877-5728-4fb8-9522-51f765c036b6 None None] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b241d03-dd77-4067-a033-594a8b7b6d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[530df5be-f9e6-493a-9859-e6f55fcde3ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:31 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:31 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b98011-c915-4763-ae3f-fd2397fcfe3d]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG os_brick.utils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:31 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Updating existing volume attachment record: 9dc67782-fdb9-4f8c-a6c2-f950fc9bdd55 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:32 user nova-compute[82850]: WARNING nova.compute.manager [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state None.
Apr 12 07:41:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:41:36 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Creating image(s)
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Ensure instance console log exists: /opt/stack/data/nova/instances/98cb3965-b028-474d-90b3-b8c6f33b62a2/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Start _get_guest_xml network_info=[{"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwolJOth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98cb3965-b028-474d-90b3-b8c6f33b62a2', 'attached_at': '', 'detached_at': '', 'volume_id': '9e53974a-e0a4-4fc6-bf20-26819990fd45', 'serial': '9e53974a-e0a4-4fc6-bf20-26819990fd45'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '9dc67782-fdb9-4f8c-a6c2-f950fc9bdd55', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:41:36 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:36 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwolJOth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:36 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:36 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:36 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[201a877d-60c6-4235-bf47-20d4d835f135]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:36 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfed525d-8033-42de-b143-7410ec32310f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45] added
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4ba46-a1e9-4bf9-8c74-e304b7904202]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb8899-dc14-4245-964d-2df9073fe5b2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwolJOth {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwolJOth" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a91f6-37b5-4bc6-bd0d-0f8a2c03f7e1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CwolJOth'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.097s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be7783-7d15-44cf-b0c2-a303ce162da4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c18999-13fb-4e41-8718-3dba1bf6766e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5a4a3-a006-494b-ae3a-6b520b444fb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260]
Apr 12 07:41:36 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d09495-60fe-42f0-9962-dbdde4f18bbf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ee246-6c53-4a7c-96ec-02073080edca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:36 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:36 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bbc497-1799-4994-9fba-2ab3e4244250]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:36 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwolJOth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23062356631383462', 'path': '/dev/sdf'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062356631383462', 'path': '/dev/sdf'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841248973',display_name='tempest-TestVolumeBootPattern-server-1841248973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841248973',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ge04i4ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:25Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=98cb3965-b028-474d-90b3-b8c6f33b62a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 98cb3965-b028-474d-90b3-b8c6f33b62a2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:41:37 user nova-compute[82850]:   <uuid>98cb3965-b028-474d-90b3-b8c6f33b62a2</uuid>
Apr 12 07:41:37 user nova-compute[82850]:   <name>instance-0000000e</name>
Apr 12 07:41:37 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:41:37 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:41:37 user nova-compute[82850]:   <metadata>
Apr 12 07:41:37 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:41:37 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:41:37 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-server-1841248973</nova:name>
Apr 12 07:41:37 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:41:36</nova:creationTime>
Apr 12 07:41:37 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:41:37 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:41:37 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:41:37 user nova-compute[82850]:       <nova:owner>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:41:37 user nova-compute[82850]:       </nova:owner>
Apr 12 07:41:37 user nova-compute[82850]:       <nova:ports>
Apr 12 07:41:37 user nova-compute[82850]:         <nova:port uuid="9e37061f-71da-4cdf-b22b-814cda161f85">
Apr 12 07:41:37 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:41:37 user nova-compute[82850]:         </nova:port>
Apr 12 07:41:37 user nova-compute[82850]:       </nova:ports>
Apr 12 07:41:37 user nova-compute[82850]:     </nova:instance>
Apr 12 07:41:37 user nova-compute[82850]:   </metadata>
Apr 12 07:41:37 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:41:37 user nova-compute[82850]:     <system>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="serial">98cb3965-b028-474d-90b3-b8c6f33b62a2</entry>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="uuid">98cb3965-b028-474d-90b3-b8c6f33b62a2</entry>
Apr 12 07:41:37 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:41:37 user nova-compute[82850]:     </system>
Apr 12 07:41:37 user nova-compute[82850]:   </sysinfo>
Apr 12 07:41:37 user nova-compute[82850]:   <os>
Apr 12 07:41:37 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:41:37 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:41:37 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:41:37 user nova-compute[82850]:   </os>
Apr 12 07:41:37 user nova-compute[82850]:   <features>
Apr 12 07:41:37 user nova-compute[82850]:     <acpi/>
Apr 12 07:41:37 user nova-compute[82850]:     <apic/>
Apr 12 07:41:37 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:41:37 user nova-compute[82850]:   </features>
Apr 12 07:41:37 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:41:37 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:41:37 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:41:37 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:41:37 user nova-compute[82850]:   </clock>
Apr 12 07:41:37 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:41:37 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:41:37 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:41:37 user nova-compute[82850]:   </cpu>
Apr 12 07:41:37 user nova-compute[82850]:   <devices>
Apr 12 07:41:37 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:41:37 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:41:37 user nova-compute[82850]:       <source dev="/dev/sdf"/>
Apr 12 07:41:37 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:41:37 user nova-compute[82850]:       <serial>9e53974a-e0a4-4fc6-bf20-26819990fd45</serial>
Apr 12 07:41:37 user nova-compute[82850]:     </disk>
Apr 12 07:41:37 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:41:37 user nova-compute[82850]:       <mac address="fa:16:3e:be:09:fd"/>
Apr 12 07:41:37 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:37 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:41:37 user nova-compute[82850]:       <target dev="tap9e37061f-71"/>
Apr 12 07:41:37 user nova-compute[82850]:     </interface>
Apr 12 07:41:37 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:41:37 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/98cb3965-b028-474d-90b3-b8c6f33b62a2/console.log" append="off"/>
Apr 12 07:41:37 user nova-compute[82850]:     </serial>
Apr 12 07:41:37 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:41:37 user nova-compute[82850]:     <video>
Apr 12 07:41:37 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:41:37 user nova-compute[82850]:     </video>
Apr 12 07:41:37 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:41:37 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:41:37 user nova-compute[82850]:     </rng>
Apr 12 07:41:37 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:41:37 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:41:37 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:41:37 user nova-compute[82850]:     </memballoon>
Apr 12 07:41:37 user nova-compute[82850]:   </devices>
Apr 12 07:41:37 user nova-compute[82850]: </domain>
Apr 12 07:41:37 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841248973',display_name='tempest-TestVolumeBootPattern-server-1841248973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841248973',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ge04i4ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:25Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=98cb3965-b028-474d-90b3-b8c6f33b62a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG os_vif [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e37061f-71, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e37061f-71, col_values=(('external_ids', {'iface-id': '9e37061f-71da-4cdf-b22b-814cda161f85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:09:fd', 'vm-uuid': '98cb3965-b028-474d-90b3-b8c6f33b62a2'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:37 user nova-compute[82850]: INFO os_vif [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71')
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:be:09:fd, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] No waiting events found dispatching network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:39 user nova-compute[82850]: WARNING nova.compute.manager [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received unexpected event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 for instance with vm_state building and task_state spawning.
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'flavor' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:40 user nova-compute[82850]: INFO nova.compute.manager [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attaching volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af to /dev/vdb
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.utils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9197f681-5e10-497f-99e6-4e212eba31bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2673131-bd87-4553-8211-54261c015caf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ffd16b-38f0-4821-963f-c07433528fd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7fe8bc-6d67-474f-9c70-0b2a14b06740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:41 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61fc49a-b657-4c6c-a33a-2dd73e67b795]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG os_brick.utils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updating existing volume attachment record: 47113c01-229a-46d4-bbb6-3b9a84e182b9 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285301.2987103, 98cb3965-b028-474d-90b3-b8c6f33b62a2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] VM Resumed (Lifecycle Event)
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Instance spawned successfully.
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285301.3059437, 98cb3965-b028-474d-90b3-b8c6f33b62a2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] VM Started (Lifecycle Event)
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] No waiting events found dispatching network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:41 user nova-compute[82850]: WARNING nova.compute.manager [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received unexpected event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 for instance with vm_state building and task_state spawning.
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-changed-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Refreshing instance network info cache due to event network-changed-e0de1b4f-faa3-4c31-8cdd-25dff971246c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Acquiring lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Acquired lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Refreshing network info cache for port e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:41 user nova-compute[82850]: INFO nova.compute.manager [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Took 17.47 seconds to build instance.
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.677s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updated VIF entry in instance network info cache for port e0de1b4f-faa3-4c31-8cdd-25dff971246c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updating instance_info_cache with network_info: [{"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Releasing lock "refresh_cache-eee310e4-bed8-405f-bfc6-a6bc3085293d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:45 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64187a4-4d86-4d13-8904-cde7bfb9ded7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:45 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe8667-5a6a-4dac-bfd2-36565d4ca248]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af] added
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a6d8f-8acd-47cf-b107-df994c29604f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b06d78a-d407-4d02-b300-419dcfcdbf4c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOYbsEWg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOYbsEWg" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c99a3-11b5-4a0e-a4f3-20edea9de7a9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UOYbsEWg'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8623a7a7-d3bf-468d-8adb-ba61ac0850cd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab4db8-0284-474e-b16f-829b7278f786]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021e4c8-6877-4931-bf43-ec4dfe06eace]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]
Apr 12 07:41:45 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691b45d-7c0f-4c78-b708-be052fea22b8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dd02fa-53e4-4ea4-b6c0-456bc9673753]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:45 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50387e30-ad83-4f83-99b3-41bc0164da65]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285291.07774, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:41:46 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Stopped (Lifecycle Event)
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f3bc1480-13cc-4b46-abd1-d8a3dd4b9bcd None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f3bc1480-13cc-4b46-abd1-d8a3dd4b9bcd None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23361626266363133', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361626266363133', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'flavor' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:41:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:41:46 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:41:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:41:46 user nova-compute[82850]:   <serial>31c6f68c-7746-42ac-ad97-9c6e35dcc9af</serial>
Apr 12 07:41:46 user nova-compute[82850]: </disk>
Apr 12 07:41:46 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:41:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] No VIF found with MAC fa:16:3e:6a:52:ac, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.482s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.utils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[758329b5-af13-4c56-b203-eb3dad28fb84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d4194-c9e8-4828-aa97-7b3ea1999efe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c98faf-c460-4c8f-bb2b-3605229ab9dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d80cec-f5be-4526-89a8-0b99510f4965]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:49 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2217e-128e-41ec-9b98-5ad5923798d8]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:49 user nova-compute[82850]: DEBUG os_brick.utils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:49 user nova-compute[82850]: INFO nova.compute.manager [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Swapping volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af for af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:41:50 user nova-compute[82850]: DEBUG nova.compute.manager [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-changed-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG nova.compute.manager [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Refreshing instance network info cache due to event network-changed-f5da504b-425d-45d4-a150-7399af15f563. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Acquiring lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Acquired lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG nova.network.neutron [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Refreshing network info cache for port f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG nova.network.neutron [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updated VIF entry in instance network info cache for port f5da504b-425d-45d4-a150-7399af15f563. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG nova.network.neutron [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updating instance_info_cache with network_info: [{"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Releasing lock "refresh_cache-d4f9729d-3114-4fc6-a704-02f436c17614" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-changed-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing instance network info cache due to event network-changed-49ee8142-11f3-45a6-8a4d-be1968aa1ca1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing network info cache for port 49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.objects.instance [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'flavor' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:51 user nova-compute[82850]: INFO nova.compute.manager [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Attaching volume ccd4dae4-e95c-4aa8-a784-6d5953d9f828 to /dev/vdb
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.utils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aa2007-f86b-4e29-a020-bc19d2ca36de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "interface-62827796-517b-46bd-acb2-98247fa081f4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "interface-62827796-517b-46bd-acb2-98247fa081f4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'flavor' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a561f0-d01b-4f97-a1ff-93aa55796df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b830b52-9fac-48ca-b915-0fc98ffd1837]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b67ab4-8902-498f-909e-d4794ced8d89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:51 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34cfe2f-5e56-4ed9-b1f0-30e258c5c77c]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG os_brick.utils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:51 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updating existing volume attachment record: dee27d1d-f121-491b-b2d6-3366ded1797c {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'pci_requests' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updated VIF entry in instance network info cache for port 49ee8142-11f3-45a6-8a4d-be1968aa1ca1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG nova.policy [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:41:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Successfully created port: 5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-changed-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Refreshing instance network info cache due to event network-changed-0685968d-8af1-412f-8755-27d88ae32314. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Acquiring lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Acquired lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Refreshing network info cache for port 0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updated VIF entry in instance network info cache for port 0685968d-8af1-412f-8755-27d88ae32314. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updating instance_info_cache with network_info: [{"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Releasing lock "refresh_cache-76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Successfully updated port: 5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-changed-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing instance network info cache due to event network-changed-5029176a-9429-4679-a589-7443e73e2f0e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'flavor' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c', 'serial': 'af3e2849-ab76-4e11-b068-aa07f951ca6c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'serial'} {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:54 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:54 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:54 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec792e-7ca6-4ded-98a9-f339b36b973b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:54 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:54 user nova-compute[82850]: INFO nova.compute.manager [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Attaching volume 7c251c47-f086-40b0-ae27-a20206a4ffc5 to /dev/sdc
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c01ae-75dc-4ca7-9986-6fd26426921f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c] added
Apr 12 07:41:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee5c44-3289-4d39-bd8c-43d2fbd20cce]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4995483-a960-42fa-9fef-bc80859241b8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJoXfUNc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.utils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJoXfUNc" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5badde-c466-4413-b35f-e655654f16b0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJoXfUNc'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7aaf15-5cc7-4f6a-8f04-051235f955a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b262ee1-cb9d-4bdc-8480-3aa67c1626fc]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d366648-e5bd-478e-a5f3-38f732382560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70775b2-e570-4770-8cd5-bfe4360c7590]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc07ca6-25c7-4b98-bff3-4f3417ffca91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf3b54d-af7f-41ce-9ed3-dc3c3e0785c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:54 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:54 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03072b-c738-48a5-8546-c31999748de4]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG os_brick.utils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:54 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updating existing volume attachment record: 90565ee5-e476-4e64-87e0-bd9edc1f12e2 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8368d7-1b89-4231-aca4-4260083ca9fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260]
Apr 12 07:41:55 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4f8bd-2e73-4e13-a41e-b50e9aef560f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02174b2-e2ae-4456-85ab-c65f41164dd7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:55 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29d796-e41b-459b-9963-cc4139a02682]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Refreshing network info cache for port 5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG os_vif [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5029176a-94, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5029176a-94, col_values=(('external_ids', {'iface-id': '5029176a-9429-4679-a589-7443e73e2f0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:5c:f4', 'vm-uuid': '62827796-517b-46bd-acb2-98247fa081f4'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: INFO os_vif [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94')
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] attach device xml: <interface type="ethernet">
Apr 12 07:41:55 user nova-compute[82850]:   <mac address="fa:16:3e:be:5c:f4"/>
Apr 12 07:41:55 user nova-compute[82850]:   <model type="virtio"/>
Apr 12 07:41:55 user nova-compute[82850]:   <mtu size="1442"/>
Apr 12 07:41:55 user nova-compute[82850]:   <target dev="tap5029176a-94"/>
Apr 12 07:41:55 user nova-compute[82850]: </interface>
Apr 12 07:41:55 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:55 user nova-compute[82850]: WARNING nova.compute.manager [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e for instance with vm_state active and task_state None.
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updated VIF entry in instance network info cache for port 5029176a-9429-4679-a589-7443e73e2f0e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name hda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No VIF found with MAC fa:16:3e:e2:ee:72, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:41:55 user nova-compute[82850]:   <nova:package version="0.0.0"/>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:name>tempest-device-tagging-server-1072053691</nova:name>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:creationTime>2023-04-12 07:41:55</nova:creationTime>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:flavor name="m1.nano">
Apr 12 07:41:55 user nova-compute[82850]:     <nova:memory>128</nova:memory>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:disk>1</nova:disk>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:swap>0</nova:swap>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:vcpus>1</nova:vcpus>
Apr 12 07:41:55 user nova-compute[82850]:   </nova:flavor>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:owner>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:user uuid="0082023d624048c796622b4142d89ab6">tempest-TaggedAttachmentsTest-1393321118-project-member</nova:user>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:project uuid="a790f72405ee4b4ca977ba829dbd8971">tempest-TaggedAttachmentsTest-1393321118</nova:project>
Apr 12 07:41:55 user nova-compute[82850]:   </nova:owner>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:41:55 user nova-compute[82850]:   <nova:ports>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:port uuid="49ee8142-11f3-45a6-8a4d-be1968aa1ca1">
Apr 12 07:41:55 user nova-compute[82850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:41:55 user nova-compute[82850]:     </nova:port>
Apr 12 07:41:55 user nova-compute[82850]:     <nova:port uuid="5029176a-9429-4679-a589-7443e73e2f0e">
Apr 12 07:41:55 user nova-compute[82850]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Apr 12 07:41:55 user nova-compute[82850]:     </nova:port>
Apr 12 07:41:55 user nova-compute[82850]:   </nova:ports>
Apr 12 07:41:55 user nova-compute[82850]: </nova:instance>
Apr 12 07:41:55 user nova-compute[82850]:  {{(pid=82850) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 07:41:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "interface-62827796-517b-46bd-acb2-98247fa081f4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.034s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26539633261633435', 'path': '/dev/sdh'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539633261633435', 'path': '/dev/sdh'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lazy-loading 'flavor' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'flavor' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:56 user nova-compute[82850]: INFO nova.compute.manager [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Attaching volume a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 to /dev/vdb
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.utils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[620903a7-e032-44cd-a410-ce7f17ee3b5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b8812-af39-425a-b0f7-19c9382ee6a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5821e-90b1-432e-a80a-af3eca4f92d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6527e3-ef31-41f0-9768-ef0cea346624]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:41:56 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:41:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3903310-ee09-493d-adcc-8e2c98c13a5f]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG os_brick.utils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:56 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating existing volume attachment record: 73a0a150-2411-45c5-8a6e-4f37b1613e03 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 105906176 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asvIlbut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:41:57 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:57 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:41:57 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3576cfe1-a2bc-40eb-834e-d48a3f88807b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:41:57 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6cb5b8-6120-4f5b-838c-652dff64caf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828] added
Apr 12 07:41:57 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.085s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca8cc0-bc1c-4126-a6b2-cbef43ac4836]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e079fab-1562-4484-817a-00e971a79c26]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v asvIlbut {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v asvIlbut" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f73233-d470-4f2d-9072-deb1de339813]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'asvIlbut'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[24129fa3-0348-45eb-95f9-49cc5fe885bd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf09dfa-c0f4-4aa9-81e8-8a22a0cc08c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:57 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:57 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:57 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 202375168 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:41:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:41:57 user nova-compute[82850]: WARNING nova.compute.manager [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e for instance with vm_state active and task_state None.
Apr 12 07:41:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 392167424 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --login" returned: 0 in 1.103s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481862d-ab12-4f39-b923-fcff16a8c9a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260]
Apr 12 07:41:58 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260] successful.
Apr 12 07:41:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c7185-5c17-4450-884f-76fe6c43bd70]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e88bd54-c89b-4710-93ec-6e8064acf5ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:41:58 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:41:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.484s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.114s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bee721-642b-442d-b32c-143537b9203d]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:41:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 838860800 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asvIlbut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.617s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] <== connect_volume: return (2619ms) {'type': 'block', 'scsi_wwn': '26634643338383932', 'path': '/dev/sdi'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634643338383932', 'path': '/dev/sdi'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:41:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'flavor' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:42:00 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:00 user nova-compute[82850]:   <source dev="/dev/sdi"/>
Apr 12 07:42:00 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:00 user nova-compute[82850]:   <serial>ccd4dae4-e95c-4aa8-a784-6d5953d9f828</serial>
Apr 12 07:42:00 user nova-compute[82850]: </disk>
Apr 12 07:42:00 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 983564288 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No VIF found with MAC fa:16:3e:88:83:08, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 998244352 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.082s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAJugvjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:00 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:00 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:00 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:42:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[403050e3-20c3-45fc-8458-0a450fabd39d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:42:01 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d026ecd-a991-4734-989b-0b83469982bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5] added
Apr 12 07:42:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec7614-ab4f-4133-800f-d2d78298619a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e7ad87-4584-4b0f-ba8f-cade4433d407]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAJugvjU {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAJugvjU" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb32fdc6-4093-456e-8257-b74513f27076]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qAJugvjU'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a2b17-b29c-4749-bd4c-2595390d1d2c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44554726-be4f-4406-8761-102076d4f1c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:01 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:01 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:01 user nova-compute[82850]: INFO nova.compute.manager [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Detaching volume ccd4dae4-e95c-4aa8-a784-6d5953d9f828
Apr 12 07:42:01 user nova-compute[82850]: INFO nova.virt.block_device [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Attempting to driver detach volume ccd4dae4-e95c-4aa8-a784-6d5953d9f828 from mountpoint /dev/vdb
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Attempting to detach device vdb from instance d4f9729d-3114-4fc6-a704-02f436c17614 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:01 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:01 user nova-compute[82850]:   <source dev="/dev/sdi"/>
Apr 12 07:42:01 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:01 user nova-compute[82850]:   <serial>ccd4dae4-e95c-4aa8-a784-6d5953d9f828</serial>
Apr 12 07:42:01 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:42:01 user nova-compute[82850]: </disk>
Apr 12 07:42:01 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:01 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully detached device vdb from instance d4f9729d-3114-4fc6-a704-02f436c17614 from the persistent domain config.
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f9729d-3114-4fc6-a704-02f436c17614 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:42:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:01 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:01 user nova-compute[82850]:   <source dev="/dev/sdi"/>
Apr 12 07:42:01 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:01 user nova-compute[82850]:   <serial>ccd4dae4-e95c-4aa8-a784-6d5953d9f828</serial>
Apr 12 07:42:01 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:42:01 user nova-compute[82850]: </disk>
Apr 12 07:42:01 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285322.2508364, d4f9729d-3114-4fc6-a704-02f436c17614 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:42:02 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully detached device vdb from instance d4f9729d-3114-4fc6-a704-02f436c17614 from the live domain config.
Apr 12 07:42:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asvIlbut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:02 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --login" returned: 0 in 1.094s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[788487b0-a4d2-414a-88ef-3d8b1d9f051d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260]
Apr 12 07:42:02 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:02 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[226fd2ca-a625-44b3-86a5-6b86dc843235]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WngMuNGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:02 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b879e-3a0e-4968-99c1-c4eeb08a7b11]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:02 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:02 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:02 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.343s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7deeb9-ecca-41bf-882c-0e044984d449]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:02 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAJugvjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.388s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] <== connect_volume: return (2390ms) {'type': 'block', 'scsi_wwn': '23035643965646162', 'path': '/dev/sdj'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035643965646162', 'path': '/dev/sdj'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.028s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'flavor' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3335b991-35d5-4141-968f-d2e45aebc51c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]: iSNS:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]: STATIC:
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:03 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:03 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:42:03 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:03 user nova-compute[82850]:   <source dev="/dev/sdj"/>
Apr 12 07:42:03 user nova-compute[82850]:   <target dev="sdc" bus="scsi"/>
Apr 12 07:42:03 user nova-compute[82850]:   <serial>7c251c47-f086-40b0-ae27-a20206a4ffc5</serial>
Apr 12 07:42:03 user nova-compute[82850]:   <address type="drive" controller="0" unit="2"/>
Apr 12 07:42:03 user nova-compute[82850]: </disk>
Apr 12 07:42:03 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc824b0-e230-4b32-a447-e3767696f08f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc916d3-4e77-45d8-bcae-2ff465f63706]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c2a8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dfffe6-1465-46f1-a0bd-f8a32d2eddb1]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a52077-d670-40c8-84f8-a57db58d20b6]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9d952-8c1d-42f7-8784-dafeb96988d7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0856a7-15c2-46ec-aed3-1e196e603e29]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b251d-0d0d-4190-97d1-73b8faab7631]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d09cf7-0683-4953-a4b3-57b2902dcf84]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]
Apr 12 07:42:03 user nova-compute[82850]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b6b01-9722-489d-8eea-0ee63e634512]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== disconnect_volume: return (2359ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.449s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde6fc2-e97a-48d6-b099-e35fe833045d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]: iSNS:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]: STATIC:
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:03 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:03 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:03 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:03 user nova-compute[82850]: No targets found.
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:03 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:03 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bed741-f900-4fa8-b9a3-a171b48200b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c', 'serial'} {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: removing Cinder connection for volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe0f6f-cec8-4da7-b5fc-660eb5deed50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:03 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c589360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828'): ({'sdi'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Removing single pathed devices sdi {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16fc07d-a526-4fe0-8f90-519cca077613]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[140c5fef-24f1-45a6-90f6-eedafdb5560b]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flushing IO for device /dev/sdi {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e5c52-fe00-40a8-997e-a7dd5bdf599c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No BDM found with device name sda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] No VIF found with MAC fa:16:3e:10:67:27, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9cbba-ea42-44fc-9eea-0a8df004df4a]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] SCSI volumes sdi have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec02db-41bf-4f10-888e-8e6c1a09dc91]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.238s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7632d15c-2ad3-42d5-8e5b-07cda5e3cae1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260]
Apr 12 07:42:04 user nova-compute[82850]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd4dae4-e95c-4aa8-a784-6d5953d9f828 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[137bf447-4673-4ee2-be88-5d0b586eca5e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] <== disconnect_volume: return (1797ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.753s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:04 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:04 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367952a-b7b5-456e-acbe-5212afaa58cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:42:04 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ef4d3-bb23-46ce-ade8-c61b452e250b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6] added
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c6572-2734-4449-a87a-447de7bda041]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b75d7b-4359-4fd4-99dd-546d668f37d7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WngMuNGI {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WngMuNGI" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[619aea2d-49ce-47ed-a860-754b16db9713]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WngMuNGI'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a35d3-a864-4850-a500-1c899ed19695]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5aaff6-f7a3-4763-a83c-91057b1de378]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f0673-6425-4e62-80ef-1b21c0deb41d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260]
Apr 12 07:42:04 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22cbef6-151f-40f1-8ff8-23b09be4a44c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df6026-2403-4558-b528-d0fad6b703a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:04 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d4e7a0-9d83-4be3-8363-3886902979c3]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: Updating volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "iJoXfUNc", "auth_password": "2hEZ6SIPaY0GoX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "af3e2849-ab76-4e11-b068-aa07f951ca6c"}, "status": "reserved", "instance": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "attached_at": "", "detached_at": "", "volume_id": "af3e2849-ab76-4e11-b068-aa07f951ca6c", "serial": "af3e2849-ab76-4e11-b068-aa07f951ca6c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c', 'no_device': None, 'attachment_id': '174b1e01-01b1-4fa8-bb48-a201a35f204e'} {{(pid=82850) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.503s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'flavor' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.178s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.utils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WngMuNGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] <== connect_volume: return (3103ms) {'type': 'block', 'scsi_wwn': '26435623335643937', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435623335643937', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3494b8-ebb6-4053-816a-aa1478a79441]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'flavor' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e3dff3-74cd-45b4-8207-8cd7715e4849]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:42:05 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:05 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:42:05 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:05 user nova-compute[82850]:   <serial>a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6</serial>
Apr 12 07:42:05 user nova-compute[82850]: </disk>
Apr 12 07:42:05 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30408b77-85b7-42ac-8c44-ed35338a484d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef2b8a-e1b3-429a-a141-c07e0c424617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:42:05 user nova-compute[82850]: INFO nova.compute.manager [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Detaching volume 7c251c47-f086-40b0-ae27-a20206a4ffc5
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:42:05 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:42:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced8d2e6-ecbb-476d-80a9-95261285c116]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG os_brick.utils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:05 user nova-compute[82850]: INFO nova.virt.block_device [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Attempting to driver detach volume 7c251c47-f086-40b0-ae27-a20206a4ffc5 from mountpoint /dev/sdc
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Attempting to detach device sdc from instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:05 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:05 user nova-compute[82850]:   <source dev="/dev/sdj"/>
Apr 12 07:42:05 user nova-compute[82850]:   <target dev="sdc" bus="scsi"/>
Apr 12 07:42:05 user nova-compute[82850]:   <serial>7c251c47-f086-40b0-ae27-a20206a4ffc5</serial>
Apr 12 07:42:05 user nova-compute[82850]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 07:42:05 user nova-compute[82850]: </disk>
Apr 12 07:42:05 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Successfully detached device sdc from instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 from the persistent domain config.
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:05 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:05 user nova-compute[82850]:   <source dev="/dev/sdj"/>
Apr 12 07:42:05 user nova-compute[82850]:   <target dev="sdc" bus="scsi"/>
Apr 12 07:42:05 user nova-compute[82850]:   <serial>7c251c47-f086-40b0-ae27-a20206a4ffc5</serial>
Apr 12 07:42:05 user nova-compute[82850]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 07:42:05 user nova-compute[82850]: </disk>
Apr 12 07:42:05 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:05 user nova-compute[82850]: INFO nova.compute.manager [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Swapping volume af3e2849-ab76-4e11-b068-aa07f951ca6c for 31c6f68c-7746-42ac-ad97-9c6e35dcc9af
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No BDM found with device name hda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] No VIF found with MAC fa:16:3e:e2:ee:72, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.561s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285326.103961, 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:42:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Successfully detached device sdc from instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 from the live domain config.
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAJugvjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727cbc0-f3d0-4f6f-a54f-1e4f807f68d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:06 user nova-compute[82850]: No targets found.
Apr 12 07:42:06 user nova-compute[82850]: iSNS:
Apr 12 07:42:06 user nova-compute[82850]: No targets found.
Apr 12 07:42:06 user nova-compute[82850]: STATIC:
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:06 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:06 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:06 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:06 user nova-compute[82850]: No targets found.
Apr 12 07:42:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:06 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:06 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f380231-e08e-4938-9267-0f8865b01a2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87194488-a13e-49a2-be90-4d072e5267b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:06 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c2a8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5'): ({'sdj'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Removing single pathed devices sdj {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61a95fa-3686-4fdd-80c8-176d91fba7ad]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f43b1b-00a5-4b74-9fd8-cfd3adec889d]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Flushing IO for device /dev/sdj {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db906b-023e-4557-a44d-76f5fcfc3574]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cdd123-d3d5-41c9-9f8d-1795e7924056]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] SCSI volumes sdj have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aebfbfb-9c94-4190-9470-3bd8b3a57bff]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e9d486-c75c-47f5-b4c7-2967311d4acb]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260]
Apr 12 07:42:06 user nova-compute[82850]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c251c47-f086-40b0-ae27-a20206a4ffc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6494dbe2-1a53-4c0d-a17c-9085c7930839]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] <== disconnect_volume: return (354ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:06 user nova-compute[82850]: INFO nova.compute.manager [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Detaching volume a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6
Apr 12 07:42:06 user nova-compute[82850]: INFO nova.virt.block_device [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Attempting to driver detach volume a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 from mountpoint /dev/vdb
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Attempting to detach device vdb from instance 62827796-517b-46bd-acb2-98247fa081f4 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:06 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:06 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:42:06 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:06 user nova-compute[82850]:   <serial>a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6</serial>
Apr 12 07:42:06 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 07:42:06 user nova-compute[82850]: </disk>
Apr 12 07:42:06 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully detached device vdb from instance 62827796-517b-46bd-acb2-98247fa081f4 from the persistent domain config.
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62827796-517b-46bd-acb2-98247fa081f4 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:42:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:06 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:06 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:42:06 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:06 user nova-compute[82850]:   <serial>a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6</serial>
Apr 12 07:42:06 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 07:42:06 user nova-compute[82850]: </disk>
Apr 12 07:42:06 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'flavor' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.881s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285327.4441912, 62827796-517b-46bd-acb2-98247fa081f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:42:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully detached device vdb from instance 62827796-517b-46bd-acb2-98247fa081f4 from the live domain config.
Apr 12 07:42:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WngMuNGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe9cf3-2b19-4df8-890a-e8ed5f526f7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:07 user nova-compute[82850]: No targets found.
Apr 12 07:42:07 user nova-compute[82850]: iSNS:
Apr 12 07:42:07 user nova-compute[82850]: No targets found.
Apr 12 07:42:07 user nova-compute[82850]: STATIC:
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:07 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:07 user nova-compute[82850]: No targets found.
Apr 12 07:42:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:07 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:07 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f72775b-4bfd-4d70-b724-ac29ee9455df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4bbf6c-1a94-497d-bfa8-2aeea081b9a0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:07 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194eca8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46814830-3cbf-456c-9bfd-5582e72a3ff2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[705f42b4-7a81-4669-ba65-74d1e290d7e8]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0faf417-cbb6-4dd5-b8b8-c188e517d2cf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb78702-cc94-420e-b374-29779b8fbc1e]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[228cd3cc-ec2e-44c8-8835-f546c3439037]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b0e54-df03-49c7-b17b-c996ff04912a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260]
Apr 12 07:42:07 user nova-compute[82850]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b30552-bcc4-4447-b002-dc6056e98e31]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] <== disconnect_volume: return (337ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:08 user nova-compute[82850]: INFO nova.compute.manager [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Terminating instance
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-unplugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] No waiting events found dispatching network-vif-unplugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-unplugged-0685968d-8af1-412f-8755-27d88ae32314 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'flavor' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.933s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Instance destroyed successfully.
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'resources' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-977931869',display_name='tempest-AttachSCSIVolumeTestJSON-server-977931869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-977931869',id=11,image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGwHDucxhfjXyaWw5D2kxH8A4L6D9HQliW9y3ojju8EU9ZXEg3SpzTGASkavRgR8pe9xIAbGFPQVL37SmYxaD49MN9pk/kPq0XfH/d08Jmy/UlGf4WQY+n1rtDufliS0w==',key_name='tempest-keypair-1375571147',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a7b4669bf684bdaa24332f6821c7186',ramdisk_id='',reservation_id='r-hi1t4kqp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e37a17a0-55cd-4c56-a320-ff10e65f48f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20787824',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20787824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1945c498db466dba6c16af19ff42d0',uuid=76db9cd6-5ebe-4e71-bbda-5734ed2dbc53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converting VIF {"id": "0685968d-8af1-412f-8755-27d88ae32314", "address": "fa:16:3e:10:67:27", "network": {"id": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-98983859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a7b4669bf684bdaa24332f6821c7186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0685968d-8a", "ovs_interfaceid": "0685968d-8af1-412f-8755-27d88ae32314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG os_vif [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0685968d-8a, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:08 user nova-compute[82850]: INFO os_vif [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:67:27,bridge_name='br-int',has_traffic_filtering=True,id=0685968d-8af1-412f-8755-27d88ae32314,network=Network(7ba1738b-ea57-4e2c-a0a1-578ae35f420f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0685968d-8a')
Apr 12 07:42:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Deleting instance files /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53_del
Apr 12 07:42:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Deletion of /opt/stack/data/nova/instances/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53_del complete
Apr 12 07:42:08 user nova-compute[82850]: INFO nova.compute.manager [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 07:42:08 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:42:08 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "interface-62827796-517b-46bd-acb2-98247fa081f4-5029176a-9429-4679-a589-7443e73e2f0e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "interface-62827796-517b-46bd-acb2-98247fa081f4-5029176a-9429-4679-a589-7443e73e2f0e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'flavor' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface> {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface> {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Attempting to detach device tap5029176a-94 from instance 62827796-517b-46bd-acb2-98247fa081f4 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] detach device xml: <interface type="ethernet">
Apr 12 07:42:09 user nova-compute[82850]:   <mac address="fa:16:3e:be:5c:f4"/>
Apr 12 07:42:09 user nova-compute[82850]:   <model type="virtio"/>
Apr 12 07:42:09 user nova-compute[82850]:   <mtu size="1442"/>
Apr 12 07:42:09 user nova-compute[82850]:   <target dev="tap5029176a-94"/>
Apr 12 07:42:09 user nova-compute[82850]: </interface>
Apr 12 07:42:09 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface> {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 07:42:09 user nova-compute[82850]:   <name>instance-0000000a</name>
Apr 12 07:42:09 user nova-compute[82850]:   <uuid>62827796-517b-46bd-acb2-98247fa081f4</uuid>
Apr 12 07:42:09 user nova-compute[82850]:   <metadata>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:42:09 user nova-compute[82850]:   <nova:package version="0.0.0"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:name>tempest-device-tagging-server-1072053691</nova:name>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:creationTime>2023-04-12 07:41:55</nova:creationTime>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:flavor name="m1.nano">
Apr 12 07:42:09 user nova-compute[82850]:     <nova:memory>128</nova:memory>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:disk>1</nova:disk>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:swap>0</nova:swap>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:vcpus>1</nova:vcpus>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:flavor>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:user uuid="0082023d624048c796622b4142d89ab6">tempest-TaggedAttachmentsTest-1393321118-project-member</nova:user>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:project uuid="a790f72405ee4b4ca977ba829dbd8971">tempest-TaggedAttachmentsTest-1393321118</nova:project>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:ports>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:port uuid="49ee8142-11f3-45a6-8a4d-be1968aa1ca1">
Apr 12 07:42:09 user nova-compute[82850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:42:09 user nova-compute[82850]:     </nova:port>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:port uuid="5029176a-9429-4679-a589-7443e73e2f0e">
Apr 12 07:42:09 user nova-compute[82850]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Apr 12 07:42:09 user nova-compute[82850]:     </nova:port>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:ports>
Apr 12 07:42:09 user nova-compute[82850]: </nova:instance>
Apr 12 07:42:09 user nova-compute[82850]:   </metadata>
Apr 12 07:42:09 user nova-compute[82850]:   <memory unit='KiB'>131072</memory>
Apr 12 07:42:09 user nova-compute[82850]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 07:42:09 user nova-compute[82850]:   <vcpu placement='static'>1</vcpu>
Apr 12 07:42:09 user nova-compute[82850]:   <resource>
Apr 12 07:42:09 user nova-compute[82850]:     <partition>/machine</partition>
Apr 12 07:42:09 user nova-compute[82850]:   </resource>
Apr 12 07:42:09 user nova-compute[82850]:   <sysinfo type='smbios'>
Apr 12 07:42:09 user nova-compute[82850]:     <system>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='version'>0.0.0</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='serial'>62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='uuid'>62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='family'>Virtual Machine</entry>
Apr 12 07:42:09 user nova-compute[82850]:     </system>
Apr 12 07:42:09 user nova-compute[82850]:   </sysinfo>
Apr 12 07:42:09 user nova-compute[82850]:   <os>
Apr 12 07:42:09 user nova-compute[82850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 07:42:09 user nova-compute[82850]:     <boot dev='hd'/>
Apr 12 07:42:09 user nova-compute[82850]:     <smbios mode='sysinfo'/>
Apr 12 07:42:09 user nova-compute[82850]:   </os>
Apr 12 07:42:09 user nova-compute[82850]:   <features>
Apr 12 07:42:09 user nova-compute[82850]:     <acpi/>
Apr 12 07:42:09 user nova-compute[82850]:     <apic/>
Apr 12 07:42:09 user nova-compute[82850]:     <vmcoreinfo state='on'/>
Apr 12 07:42:09 user nova-compute[82850]:   </features>
Apr 12 07:42:09 user nova-compute[82850]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 07:42:09 user nova-compute[82850]:     <model fallback='forbid'>Nehalem</model>
Apr 12 07:42:09 user nova-compute[82850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='vme'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='x2apic'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='hypervisor'/>
Apr 12 07:42:09 user nova-compute[82850]:   </cpu>
Apr 12 07:42:09 user nova-compute[82850]:   <clock offset='utc'>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='hpet' present='no'/>
Apr 12 07:42:09 user nova-compute[82850]:   </clock>
Apr 12 07:42:09 user nova-compute[82850]:   <on_poweroff>destroy</on_poweroff>
Apr 12 07:42:09 user nova-compute[82850]:   <on_reboot>restart</on_reboot>
Apr 12 07:42:09 user nova-compute[82850]:   <on_crash>destroy</on_crash>
Apr 12 07:42:09 user nova-compute[82850]:   <devices>
Apr 12 07:42:09 user nova-compute[82850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 07:42:09 user nova-compute[82850]:     <disk type='file' device='disk'>
Apr 12 07:42:09 user nova-compute[82850]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 07:42:09 user nova-compute[82850]:       <source file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk' index='2'/>
Apr 12 07:42:09 user nova-compute[82850]:       <backingStore type='file' index='3'>
Apr 12 07:42:09 user nova-compute[82850]:         <format type='raw'/>
Apr 12 07:42:09 user nova-compute[82850]:         <source file='/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81'/>
Apr 12 07:42:09 user nova-compute[82850]:         <backingStore/>
Apr 12 07:42:09 user nova-compute[82850]:       </backingStore>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='vda' bus='virtio'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='virtio-disk0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </disk>
Apr 12 07:42:09 user nova-compute[82850]:     <disk type='file' device='cdrom'>
Apr 12 07:42:09 user nova-compute[82850]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 07:42:09 user nova-compute[82850]:       <source file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config' index='1'/>
Apr 12 07:42:09 user nova-compute[82850]:       <backingStore/>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='hda' bus='ide'/>
Apr 12 07:42:09 user nova-compute[82850]:       <readonly/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='ide0-0-0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </disk>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='usb' index='0' model='none'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='usb'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='pci.0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='ide' index='0'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='ide'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <interface type='ethernet'>
Apr 12 07:42:09 user nova-compute[82850]:       <mac address='fa:16:3e:e2:ee:72'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='tap49ee8142-11'/>
Apr 12 07:42:09 user nova-compute[82850]:       <model type='virtio'/>
Apr 12 07:42:09 user nova-compute[82850]:       <mtu size='1442'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='net0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </interface>
Apr 12 07:42:09 user nova-compute[82850]:     <interface type='ethernet'>
Apr 12 07:42:09 user nova-compute[82850]:       <mac address='fa:16:3e:be:5c:f4'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='tap5029176a-94'/>
Apr 12 07:42:09 user nova-compute[82850]:       <model type='virtio'/>
Apr 12 07:42:09 user nova-compute[82850]:       <mtu size='1442'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='net1'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </interface>
Apr 12 07:42:09 user nova-compute[82850]:     <serial type='pty'>
Apr 12 07:42:09 user nova-compute[82850]:       <source path='/dev/pts/9'/>
Apr 12 07:42:09 user nova-compute[82850]:       <log file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log' append='off'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target type='isa-serial' port='0'>
Apr 12 07:42:09 user nova-compute[82850]:         <model name='isa-serial'/>
Apr 12 07:42:09 user nova-compute[82850]:       </target>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='serial0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </serial>
Apr 12 07:42:09 user nova-compute[82850]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 07:42:09 user nova-compute[82850]:       <source path='/dev/pts/9'/>
Apr 12 07:42:09 user nova-compute[82850]:       <log file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log' append='off'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target type='serial' port='0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='serial0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </console>
Apr 12 07:42:09 user nova-compute[82850]:     <input type='mouse' bus='ps2'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='input0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </input>
Apr 12 07:42:09 user nova-compute[82850]:     <input type='keyboard' bus='ps2'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='input1'/>
Apr 12 07:42:09 user nova-compute[82850]:     </input>
Apr 12 07:42:09 user nova-compute[82850]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 07:42:09 user nova-compute[82850]:       <listen type='address' address='0.0.0.0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </graphics>
Apr 12 07:42:09 user nova-compute[82850]:     <audio id='1' type='none'/>
Apr 12 07:42:09 user nova-compute[82850]:     <video>
Apr 12 07:42:09 user nova-compute[82850]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='video0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </video>
Apr 12 07:42:09 user nova-compute[82850]:     <memballoon model='virtio'>
Apr 12 07:42:09 user nova-compute[82850]:       <stats period='10'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='balloon0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </memballoon>
Apr 12 07:42:09 user nova-compute[82850]:     <rng model='virtio'>
Apr 12 07:42:09 user nova-compute[82850]:       <backend model='random'>/dev/urandom</backend>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='rng0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </rng>
Apr 12 07:42:09 user nova-compute[82850]:   </devices>
Apr 12 07:42:09 user nova-compute[82850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 07:42:09 user nova-compute[82850]:     <label>libvirt-62827796-517b-46bd-acb2-98247fa081f4</label>
Apr 12 07:42:09 user nova-compute[82850]:     <imagelabel>libvirt-62827796-517b-46bd-acb2-98247fa081f4</imagelabel>
Apr 12 07:42:09 user nova-compute[82850]:   </seclabel>
Apr 12 07:42:09 user nova-compute[82850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 07:42:09 user nova-compute[82850]:     <label>+64055:+108</label>
Apr 12 07:42:09 user nova-compute[82850]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 07:42:09 user nova-compute[82850]:   </seclabel>
Apr 12 07:42:09 user nova-compute[82850]: </domain>
Apr 12 07:42:09 user nova-compute[82850]:  {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 07:42:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully detached device tap5029176a-94 from instance 62827796-517b-46bd-acb2-98247fa081f4 from the persistent domain config.
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] (1/8): Attempting to detach device tap5029176a-94 with device alias net1 from instance 62827796-517b-46bd-acb2-98247fa081f4 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] detach device xml: <interface type="ethernet">
Apr 12 07:42:09 user nova-compute[82850]:   <mac address="fa:16:3e:be:5c:f4"/>
Apr 12 07:42:09 user nova-compute[82850]:   <model type="virtio"/>
Apr 12 07:42:09 user nova-compute[82850]:   <mtu size="1442"/>
Apr 12 07:42:09 user nova-compute[82850]:   <target dev="tap5029176a-94"/>
Apr 12 07:42:09 user nova-compute[82850]: </interface>
Apr 12 07:42:09 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285329.481286, 62827796-517b-46bd-acb2-98247fa081f4 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Start waiting for the detach event from libvirt for device tap5029176a-94 with device alias net1 for instance 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface> {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:be:5c:f4"/><model type="virtio"/><mtu size="1442"/><target dev="tap5029176a-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 07:42:09 user nova-compute[82850]:   <name>instance-0000000a</name>
Apr 12 07:42:09 user nova-compute[82850]:   <uuid>62827796-517b-46bd-acb2-98247fa081f4</uuid>
Apr 12 07:42:09 user nova-compute[82850]:   <metadata>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:42:09 user nova-compute[82850]:   <nova:package version="0.0.0"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:name>tempest-device-tagging-server-1072053691</nova:name>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:creationTime>2023-04-12 07:41:55</nova:creationTime>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:flavor name="m1.nano">
Apr 12 07:42:09 user nova-compute[82850]:     <nova:memory>128</nova:memory>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:disk>1</nova:disk>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:swap>0</nova:swap>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:vcpus>1</nova:vcpus>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:flavor>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:user uuid="0082023d624048c796622b4142d89ab6">tempest-TaggedAttachmentsTest-1393321118-project-member</nova:user>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:project uuid="a790f72405ee4b4ca977ba829dbd8971">tempest-TaggedAttachmentsTest-1393321118</nova:project>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:ports>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:port uuid="49ee8142-11f3-45a6-8a4d-be1968aa1ca1">
Apr 12 07:42:09 user nova-compute[82850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:42:09 user nova-compute[82850]:     </nova:port>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:port uuid="5029176a-9429-4679-a589-7443e73e2f0e">
Apr 12 07:42:09 user nova-compute[82850]:       <nova:ip type="fixed" address="10.10.10.44" ipVersion="4"/>
Apr 12 07:42:09 user nova-compute[82850]:     </nova:port>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:ports>
Apr 12 07:42:09 user nova-compute[82850]: </nova:instance>
Apr 12 07:42:09 user nova-compute[82850]:   </metadata>
Apr 12 07:42:09 user nova-compute[82850]:   <memory unit='KiB'>131072</memory>
Apr 12 07:42:09 user nova-compute[82850]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 07:42:09 user nova-compute[82850]:   <vcpu placement='static'>1</vcpu>
Apr 12 07:42:09 user nova-compute[82850]:   <resource>
Apr 12 07:42:09 user nova-compute[82850]:     <partition>/machine</partition>
Apr 12 07:42:09 user nova-compute[82850]:   </resource>
Apr 12 07:42:09 user nova-compute[82850]:   <sysinfo type='smbios'>
Apr 12 07:42:09 user nova-compute[82850]:     <system>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='version'>0.0.0</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='serial'>62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='uuid'>62827796-517b-46bd-acb2-98247fa081f4</entry>
Apr 12 07:42:09 user nova-compute[82850]:       <entry name='family'>Virtual Machine</entry>
Apr 12 07:42:09 user nova-compute[82850]:     </system>
Apr 12 07:42:09 user nova-compute[82850]:   </sysinfo>
Apr 12 07:42:09 user nova-compute[82850]:   <os>
Apr 12 07:42:09 user nova-compute[82850]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 07:42:09 user nova-compute[82850]:     <boot dev='hd'/>
Apr 12 07:42:09 user nova-compute[82850]:     <smbios mode='sysinfo'/>
Apr 12 07:42:09 user nova-compute[82850]:   </os>
Apr 12 07:42:09 user nova-compute[82850]:   <features>
Apr 12 07:42:09 user nova-compute[82850]:     <acpi/>
Apr 12 07:42:09 user nova-compute[82850]:     <apic/>
Apr 12 07:42:09 user nova-compute[82850]:     <vmcoreinfo state='on'/>
Apr 12 07:42:09 user nova-compute[82850]:   </features>
Apr 12 07:42:09 user nova-compute[82850]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 07:42:09 user nova-compute[82850]:     <model fallback='forbid'>Nehalem</model>
Apr 12 07:42:09 user nova-compute[82850]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='vme'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='x2apic'/>
Apr 12 07:42:09 user nova-compute[82850]:     <feature policy='require' name='hypervisor'/>
Apr 12 07:42:09 user nova-compute[82850]:   </cpu>
Apr 12 07:42:09 user nova-compute[82850]:   <clock offset='utc'>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 07:42:09 user nova-compute[82850]:     <timer name='hpet' present='no'/>
Apr 12 07:42:09 user nova-compute[82850]:   </clock>
Apr 12 07:42:09 user nova-compute[82850]:   <on_poweroff>destroy</on_poweroff>
Apr 12 07:42:09 user nova-compute[82850]:   <on_reboot>restart</on_reboot>
Apr 12 07:42:09 user nova-compute[82850]:   <on_crash>destroy</on_crash>
Apr 12 07:42:09 user nova-compute[82850]:   <devices>
Apr 12 07:42:09 user nova-compute[82850]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 07:42:09 user nova-compute[82850]:     <disk type='file' device='disk'>
Apr 12 07:42:09 user nova-compute[82850]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 07:42:09 user nova-compute[82850]:       <source file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk' index='2'/>
Apr 12 07:42:09 user nova-compute[82850]:       <backingStore type='file' index='3'>
Apr 12 07:42:09 user nova-compute[82850]:         <format type='raw'/>
Apr 12 07:42:09 user nova-compute[82850]:         <source file='/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81'/>
Apr 12 07:42:09 user nova-compute[82850]:         <backingStore/>
Apr 12 07:42:09 user nova-compute[82850]:       </backingStore>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='vda' bus='virtio'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='virtio-disk0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </disk>
Apr 12 07:42:09 user nova-compute[82850]:     <disk type='file' device='cdrom'>
Apr 12 07:42:09 user nova-compute[82850]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 07:42:09 user nova-compute[82850]:       <source file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk.config' index='1'/>
Apr 12 07:42:09 user nova-compute[82850]:       <backingStore/>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='hda' bus='ide'/>
Apr 12 07:42:09 user nova-compute[82850]:       <readonly/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='ide0-0-0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </disk>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='usb' index='0' model='none'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='usb'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='pci.0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <controller type='ide' index='0'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='ide'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 07:42:09 user nova-compute[82850]:     </controller>
Apr 12 07:42:09 user nova-compute[82850]:     <interface type='ethernet'>
Apr 12 07:42:09 user nova-compute[82850]:       <mac address='fa:16:3e:e2:ee:72'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target dev='tap49ee8142-11'/>
Apr 12 07:42:09 user nova-compute[82850]:       <model type='virtio'/>
Apr 12 07:42:09 user nova-compute[82850]:       <mtu size='1442'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='net0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </interface>
Apr 12 07:42:09 user nova-compute[82850]:     <serial type='pty'>
Apr 12 07:42:09 user nova-compute[82850]:       <source path='/dev/pts/9'/>
Apr 12 07:42:09 user nova-compute[82850]:       <log file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log' append='off'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target type='isa-serial' port='0'>
Apr 12 07:42:09 user nova-compute[82850]:         <model name='isa-serial'/>
Apr 12 07:42:09 user nova-compute[82850]:       </target>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='serial0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </serial>
Apr 12 07:42:09 user nova-compute[82850]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 07:42:09 user nova-compute[82850]:       <source path='/dev/pts/9'/>
Apr 12 07:42:09 user nova-compute[82850]:       <log file='/opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/console.log' append='off'/>
Apr 12 07:42:09 user nova-compute[82850]:       <target type='serial' port='0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='serial0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </console>
Apr 12 07:42:09 user nova-compute[82850]:     <input type='mouse' bus='ps2'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='input0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </input>
Apr 12 07:42:09 user nova-compute[82850]:     <input type='keyboard' bus='ps2'>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='input1'/>
Apr 12 07:42:09 user nova-compute[82850]:     </input>
Apr 12 07:42:09 user nova-compute[82850]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 07:42:09 user nova-compute[82850]:       <listen type='address' address='0.0.0.0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </graphics>
Apr 12 07:42:09 user nova-compute[82850]:     <audio id='1' type='none'/>
Apr 12 07:42:09 user nova-compute[82850]:     <video>
Apr 12 07:42:09 user nova-compute[82850]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='video0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </video>
Apr 12 07:42:09 user nova-compute[82850]:     <memballoon model='virtio'>
Apr 12 07:42:09 user nova-compute[82850]:       <stats period='10'/>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='balloon0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </memballoon>
Apr 12 07:42:09 user nova-compute[82850]:     <rng model='virtio'>
Apr 12 07:42:09 user nova-compute[82850]:       <backend model='random'>/dev/urandom</backend>
Apr 12 07:42:09 user nova-compute[82850]:       <alias name='rng0'/>
Apr 12 07:42:09 user nova-compute[82850]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 07:42:09 user nova-compute[82850]:     </rng>
Apr 12 07:42:09 user nova-compute[82850]:   </devices>
Apr 12 07:42:09 user nova-compute[82850]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 07:42:09 user nova-compute[82850]:     <label>libvirt-62827796-517b-46bd-acb2-98247fa081f4</label>
Apr 12 07:42:09 user nova-compute[82850]:     <imagelabel>libvirt-62827796-517b-46bd-acb2-98247fa081f4</imagelabel>
Apr 12 07:42:09 user nova-compute[82850]:   </seclabel>
Apr 12 07:42:09 user nova-compute[82850]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 07:42:09 user nova-compute[82850]:     <label>+64055:+108</label>
Apr 12 07:42:09 user nova-compute[82850]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 07:42:09 user nova-compute[82850]:   </seclabel>
Apr 12 07:42:09 user nova-compute[82850]: </domain>
Apr 12 07:42:09 user nova-compute[82850]:  {{(pid=82850) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 07:42:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully detached device tap5029176a-94 from instance 62827796-517b-46bd-acb2-98247fa081f4 from the live domain config.
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "5029176a-9429-4679-a589-7443e73e2f0e", "address": "fa:16:3e:be:5c:f4", "network": {"id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183239333", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029176a-94", "ovs_interfaceid": "5029176a-9429-4679-a589-7443e73e2f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG os_vif [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5029176a-94, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: INFO os_vif [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:5c:f4,bridge_name='br-int',has_traffic_filtering=True,id=5029176a-9429-4679-a589-7443e73e2f0e,network=Network(39fc8c89-569f-4285-9e16-f09cdea47fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029176a-94')
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:42:09 user nova-compute[82850]:   <nova:package version="0.0.0"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:name>tempest-device-tagging-server-1072053691</nova:name>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:creationTime>2023-04-12 07:42:09</nova:creationTime>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:flavor name="m1.nano">
Apr 12 07:42:09 user nova-compute[82850]:     <nova:memory>128</nova:memory>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:disk>1</nova:disk>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:swap>0</nova:swap>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:vcpus>1</nova:vcpus>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:flavor>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:user uuid="0082023d624048c796622b4142d89ab6">tempest-TaggedAttachmentsTest-1393321118-project-member</nova:user>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:project uuid="a790f72405ee4b4ca977ba829dbd8971">tempest-TaggedAttachmentsTest-1393321118</nova:project>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:owner>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:42:09 user nova-compute[82850]:   <nova:ports>
Apr 12 07:42:09 user nova-compute[82850]:     <nova:port uuid="49ee8142-11f3-45a6-8a4d-be1968aa1ca1">
Apr 12 07:42:09 user nova-compute[82850]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:42:09 user nova-compute[82850]:     </nova:port>
Apr 12 07:42:09 user nova-compute[82850]:   </nova:ports>
Apr 12 07:42:09 user nova-compute[82850]: </nova:instance>
Apr 12 07:42:09 user nova-compute[82850]:  {{(pid=82850) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:09 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Took 0.97 seconds to deallocate network for instance.
Apr 12 07:42:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-deleted-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquired lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'serial': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c'}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c', 'serial'} {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:10 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:10 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:10 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374b523-4997-456a-ae33-bd146878ce00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:42:10 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df1c91-4463-4b45-97aa-c0628bec575c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af] added
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88cbda0-a8e9-4af0-b4c8-fcfb74932224]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Acquiring lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] No waiting events found dispatching network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:10 user nova-compute[82850]: WARNING nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Received unexpected event network-vif-plugged-0685968d-8af1-412f-8755-27d88ae32314 for instance with vm_state deleted and task_state None.
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-unplugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-unplugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:10 user nova-compute[82850]: WARNING nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-unplugged-5029176a-9429-4679-a589-7443e73e2f0e for instance with vm_state active and task_state None.
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:10 user nova-compute[82850]: WARNING nova.compute.manager [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-5029176a-9429-4679-a589-7443e73e2f0e for instance with vm_state active and task_state None.
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f8fdf-8723-4dad-88a1-9cc258a73d99]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOYbsEWg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOYbsEWg" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918b588-8109-4ec1-b7c9-b097a38506e1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UOYbsEWg'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Deleted allocations for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54498db8-1935-4ef9-9086-3a40f574faa6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e266e-97f0-4037-9bbb-860b39c3e09b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.560s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1cb7e-4ed1-44ce-9965-b6eae1da86a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]
Apr 12 07:42:10 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8683d8b-a77a-432a-b826-f43ad4261454]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f19d4-727b-442d-a78d-4499c250aa5a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:10 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:42:10 user nova-compute[82850]: INFO nova.network.neutron [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Port 5029176a-9429-4679-a589-7443e73e2f0e from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 07:42:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [{"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Releasing lock "refresh_cache-62827796-517b-46bd-acb2-98247fa081f4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[17122f62-8d27-4262-bf82-f53281ce55b5]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:42:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "interface-62827796-517b-46bd-acb2-98247fa081f4-5029176a-9429-4679-a589-7443e73e2f0e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.611s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23361626266363133', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361626266363133', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lazy-loading 'flavor' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-deleted-5029176a-9429-4679-a589-7443e73e2f0e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:42:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:14 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJoXfUNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'af3e2849-ab76-4e11-b068-aa07f951ca6c': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:15 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c434f196-6b25-40ff-8eef-0d13a70b12d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:15 user nova-compute[82850]: No targets found.
Apr 12 07:42:15 user nova-compute[82850]: iSNS:
Apr 12 07:42:15 user nova-compute[82850]: No targets found.
Apr 12 07:42:15 user nova-compute[82850]: STATIC:
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:15 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:15 user nova-compute[82850]: No targets found.
Apr 12 07:42:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:15 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:15 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a7389-cbc3-4832-85a9-6a92bca9670e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc3a25-64ca-44cd-894a-25a939942318]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:15 user nova-compute[82850]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c (non-flash)
Apr 12 07:42:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c4eef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c'): ({'sdh'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Removing single pathed devices sdh {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f99e97-7dc0-46ee-b9c0-aacf7951725b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e656e96-0822-466c-a50b-6c003b5b65a9]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Flushing IO for device /dev/sdh {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1045cc-7291-4403-b717-1bb8c15bdb7b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce94a5-ae8c-4508-befc-6ef8f6a4265a]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] SCSI volumes sdh have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b556ab2-fd48-47bd-a53e-60561c306b2f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd2c461-8234-4ff1-bf04-ffa1938d23c7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260]
Apr 12 07:42:16 user nova-compute[82850]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3e2849-ab76-4e11-b068-aa07f951ca6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243cb93-7301-4ffa-b7de-b3b235c8fe4e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] <== disconnect_volume: return (399ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'eee310e4-bed8-405f-bfc6-a6bc3085293d', 'attached_at': '', 'detached_at': '', 'volume_id': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'serial'} {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: removing Cinder connection for volume af3e2849-ab76-4e11-b068-aa07f951ca6c {{(pid=82850) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] swap_volume: Updating volume af3e2849-ab76-4e11-b068-aa07f951ca6c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UOYbsEWg", "auth_password": "c4LTfo18FqaGWV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "31c6f68c-7746-42ac-ad97-9c6e35dcc9af"}, "status": "reserved", "instance": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "attached_at": "", "detached_at": "", "volume_id": "31c6f68c-7746-42ac-ad97-9c6e35dcc9af", "serial": "31c6f68c-7746-42ac-ad97-9c6e35dcc9af"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'no_device': None, 'attachment_id': 'd689cac6-d761-47c0-803f-9cc2ac5030f2'} {{(pid=82850) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.921s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:18 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:42:18 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:42:18 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7289MB free_disk=26.33110809326172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:18 user nova-compute[82850]: INFO nova.compute.manager [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Detaching volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af
Apr 12 07:42:19 user nova-compute[82850]: INFO nova.virt.block_device [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Attempting to driver detach volume 31c6f68c-7746-42ac-ad97-9c6e35dcc9af from mountpoint /dev/vdb
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Attempting to detach device vdb from instance eee310e4-bed8-405f-bfc6-a6bc3085293d from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:19 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:19 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:42:19 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:19 user nova-compute[82850]:   <serial>31c6f68c-7746-42ac-ad97-9c6e35dcc9af</serial>
Apr 12 07:42:19 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:42:19 user nova-compute[82850]: </disk>
Apr 12 07:42:19 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Successfully detached device vdb from instance eee310e4-bed8-405f-bfc6-a6bc3085293d from the persistent domain config.
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eee310e4-bed8-405f-bfc6-a6bc3085293d from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:42:19 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:42:19 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:42:19 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:42:19 user nova-compute[82850]:   <serial>31c6f68c-7746-42ac-ad97-9c6e35dcc9af</serial>
Apr 12 07:42:19 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:42:19 user nova-compute[82850]: </disk>
Apr 12 07:42:19 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance eee310e4-bed8-405f-bfc6-a6bc3085293d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 62827796-517b-46bd-acb2-98247fa081f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285339.5242486, eee310e4-bed8-405f-bfc6-a6bc3085293d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:42:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Successfully detached device vdb from instance eee310e4-bed8-405f-bfc6-a6bc3085293d from the live domain config.
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOYbsEWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '31c6f68c-7746-42ac-ad97-9c6e35dcc9af': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:19 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20f678-c578-441c-8bb6-0b67ce5a6ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:19 user nova-compute[82850]: No targets found.
Apr 12 07:42:19 user nova-compute[82850]: iSNS:
Apr 12 07:42:19 user nova-compute[82850]: No targets found.
Apr 12 07:42:19 user nova-compute[82850]: STATIC:
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:19 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:19 user nova-compute[82850]: No targets found.
Apr 12 07:42:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:19 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:19 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[036efe9a-a398-483e-b3fb-3d177228ba22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ffb5f-3821-4721-8d51-76f41363456f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:19 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951fa3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[729aa449-74f7-45bf-9903-aa864330ff44]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f476edf1-6826-477d-bdd6-d75c690c2226]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef2027-3d83-41cd-9838-4429031957f5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a659d3f-c334-4524-bba5-cf8ad47cfeba]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[32be3a17-2792-4e00-b5df-bd9d8a9edcce]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05be00-7706-44a7-ac96-ac77045ee9ec]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260]
Apr 12 07:42:19 user nova-compute[82850]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31c6f68c-7746-42ac-ad97-9c6e35dcc9af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7bb3e-6820-4ad9-abd3-1f562f3067f3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] <== disconnect_volume: return (323ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:42:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:42:20 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'flavor' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.768s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:23 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285328.838142, 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:42:23 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] VM Stopped (Lifecycle Event)
Apr 12 07:42:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-7050431c-1d5a-4ede-a478-b8cbd06558d1 None None] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-changed-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing instance network info cache due to event network-changed-b1942edc-4ba6-4b7f-b375-cfc4429e61e1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Acquiring lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Acquired lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:42:24 user nova-compute[82850]: DEBUG nova.network.neutron [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Refreshing network info cache for port b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:42:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updated VIF entry in instance network info cache for port b1942edc-4ba6-4b7f-b375-cfc4429e61e1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:42:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Releasing lock "refresh_cache-23c2ab3f-ce38-434b-a879-91f43d16f730" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:42:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:27 user nova-compute[82850]: INFO nova.compute.manager [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Terminating instance
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-d8c70afe-012b-434e-a992-d87aff92acfa for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Instance destroyed successfully.
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lazy-loading 'resources' on Instance uuid 23c2ab3f-ce38-434b-a879-91f43d16f730 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1942edc-4b, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d7:f7,bridge_name='br-int',has_traffic_filtering=True,id=b1942edc-4ba6-4b7f-b375-cfc4429e61e1,network=Network(1287569d-de91-4614-b2fd-e17004f43121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1942edc-4b')
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2817bde8-a4, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:31:9b,bridge_name='br-int',has_traffic_filtering=True,id=2817bde8-a488-48b9-a877-32abe9e58c2b,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2817bde8-a4')
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7522065e-41, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:27:14,bridge_name='br-int',has_traffic_filtering=True,id=7522065e-41bf-4026-a63d-998d70579447,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7522065e-41')
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75ebd090-5c, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:34:37,bridge_name='br-int',has_traffic_filtering=True,id=75ebd090-5ce9-45a9-9eab-fd31dccfebb2,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ebd090-5c')
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap686e8d90-a1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:41:de,bridge_name='br-int',has_traffic_filtering=True,id=686e8d90-a1be-43bf-86d2-72830eb7f3b9,network=Network(93f2a36f-5163-4e59-a2cb-3629202e80a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686e8d90-a1')
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "address": "fa:16:3e:60:5f:db", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e64b3a6-89", "ovs_interfaceid": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e64b3a6-89, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5f:db,bridge_name='br-int',has_traffic_filtering=True,id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e64b3a6-89')
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30542415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-30542415',id=12,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg==',key_name='tempest-keypair-413750630',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a14e30be0d8491a915bb08ed9d296ce',ramdisk_id='',reservation_id='r-z9rm0gce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1306806466',owner_user_name='tempest-TaggedBootDevicesTest_v242-1306806466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74586fa38f44010878c70a8e60395ae',uuid=23c2ab3f-ce38-434b-a879-91f43d16f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converting VIF {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c70afe-01, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:29 user nova-compute[82850]: INFO os_vif [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:90:3c,bridge_name='br-int',has_traffic_filtering=True,id=d8c70afe-012b-434e-a992-d87aff92acfa,network=Network(064c42bd-13dd-4650-ae07-2582fd96b4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c70afe-01')
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKUzspYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b2b98-c32f-4cf8-a16c-94020957e8b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: iSNS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: STATIC:
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:29 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe814ef-0b8a-4bff-bbde-99ef64fcc741]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b9f6b0-42ac-4ac2-b09d-905d0a90e0e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951e72c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34462f32-ab5a-48fb-8ed4-e17ca251fa97]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8ae99-d7bd-47dd-a8a9-3a3b589d015f]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ab77f-a11a-4c9c-aa98-2ee6f4bdaafc]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885f574-3108-4311-8d14-135a8b6b95ed]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38d301-f97b-4e03-bb35-83716a8b3318]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed210601-8c54-4a78-b14a-624205f6c2d1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260]
Apr 12 07:42:29 user nova-compute[82850]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642e1f33-fca6-4bcd-8c1e-74088387ef60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23811b7b-03cb-4cfc-aca9-22d1c5b4fa3c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== disconnect_volume: return (336ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDUHwBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-2817bde8-a488-48b9-a877-32abe9e58c2b for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-2817bde8-a488-48b9-a877-32abe9e58c2b for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-7522065e-41bf-4026-a63d-998d70579447 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-7522065e-41bf-4026-a63d-998d70579447 for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ec90d-2556-4f6e-8245-f600c94f48d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: iSNS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: STATIC:
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:29 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44281b-b41a-4414-a1a1-002b8976f4aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee4f5b-9055-4848-9dfc-7395fb151028]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c2a8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3fcf9-a925-4e43-946d-bc6094e4de6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bfb27b-d4fd-4c75-adc8-ef7e8cdf1185]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[864be8d7-a469-4079-a406-e471ffbe7533]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[db976f3f-8731-4a92-a209-126d1984a264]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3728b-ea0a-4131-a2cf-cc11b6365b7d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae169f81-1692-412e-966e-a3c1f4a73d93]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260]
Apr 12 07:42:29 user nova-compute[82850]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-unplugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-unplugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING nova.compute.manager [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance with vm_state active and task_state deleting.
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d9e2b9f-1085-4d1c-9637-d640e3136de3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e014bf3-2fae-47ce-bdba-f8529aad304a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== disconnect_volume: return (313ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaPQxMum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:42:29 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a97590-1e6e-4c24-82e8-2e92a369a0d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: iSNS:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]: STATIC:
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369
Apr 12 07:42:29 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:42:29 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:42:29 user nova-compute[82850]: FIRMWARE:
Apr 12 07:42:29 user nova-compute[82850]: No targets found.
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:42:29 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:42:29 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[96caa88e-31fc-46b1-87f3-590998564578]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9058e4-b87b-45ca-b95f-49e841e7e10f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:42:29 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:42:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951e496c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369'): ({'sdd'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Removing single pathed devices sdd {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662ca4a-9041-4053-b3bd-226389508faf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6d208-0e67-436b-b5fb-c75497098d8d]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flushing IO for device /dev/sdd {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44ec92-e068-433b-bce9-53211cf57fab]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[743cd5ea-c2e6-4369-bce7-c9615993ba8f]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:42:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee160a-04d4-4b48-8857-f4e940839616]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b918d3-72f8-4c17-85d1-fd9fc9ed29df]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260]
Apr 12 07:42:30 user nova-compute[82850]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369, portal: 172.16.0.220,3260] successful.
Apr 12 07:42:30 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8669056-e4c7-4a8d-89e3-55640deee369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e9d070-477d-4aa5-95e2-f3841ab6cd86]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] <== disconnect_volume: return (303ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:42:30 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Deleting instance files /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730_del
Apr 12 07:42:30 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Deletion of /opt/stack/data/nova/instances/23c2ab3f-ce38-434b-a879-91f43d16f730_del complete
Apr 12 07:42:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Acquiring lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] No waiting events found dispatching network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:30 user nova-compute[82850]: WARNING nova.compute.manager [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received unexpected event network-vif-plugged-d8c70afe-012b-434e-a992-d87aff92acfa for instance with vm_state active and task_state deleting.
Apr 12 07:42:30 user nova-compute[82850]: INFO nova.compute.manager [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Took 3.15 seconds to destroy the instance on the hypervisor.
Apr 12 07:42:30 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:42:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-deleted-9e64b3a6-89bf-4238-83c1-fb78e3554ce6 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:32 user nova-compute[82850]: INFO nova.compute.manager [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Neutron deleted interface 9e64b3a6-89bf-4238-83c1-fb78e3554ce6; detaching it from the instance and deleting it from the info cache
Apr 12 07:42:32 user nova-compute[82850]: DEBUG nova.network.neutron [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [{"id": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "address": "fa:16:3e:b7:d7:f7", "network": {"id": "1287569d-de91-4614-b2fd-e17004f43121", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1558212452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1942edc-4b", "ovs_interfaceid": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2817bde8-a488-48b9-a877-32abe9e58c2b", "address": "fa:16:3e:9e:31:9b", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2817bde8-a4", "ovs_interfaceid": "2817bde8-a488-48b9-a877-32abe9e58c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7522065e-41bf-4026-a63d-998d70579447", "address": "fa:16:3e:d3:27:14", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7522065e-41", "ovs_interfaceid": "7522065e-41bf-4026-a63d-998d70579447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "address": "fa:16:3e:c9:34:37", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ebd090-5c", "ovs_interfaceid": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "address": "fa:16:3e:59:41:de", "network": {"id": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1931496534", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686e8d90-a1", "ovs_interfaceid": "686e8d90-a1be-43bf-86d2-72830eb7f3b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8c70afe-012b-434e-a992-d87aff92acfa", "address": "fa:16:3e:06:90:3c", "network": {"id": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1857835314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a14e30be0d8491a915bb08ed9d296ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c70afe-01", "ovs_interfaceid": "d8c70afe-012b-434e-a992-d87aff92acfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Detach interface failed, port_id=9e64b3a6-89bf-4238-83c1-fb78e3554ce6, reason: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:42:33 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:33 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Took 3.73 seconds to deallocate network for instance.
Apr 12 07:42:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-deleted-75ebd090-5ce9-45a9-9eab-fd31dccfebb2 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-deleted-d8c70afe-012b-434e-a992-d87aff92acfa {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-deleted-b1942edc-4ba6-4b7f-b375-cfc4429e61e1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:34 user nova-compute[82850]: DEBUG nova.compute.manager [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Received event network-vif-deleted-686e8d90-a1be-43bf-86d2-72830eb7f3b9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:36 user nova-compute[82850]: INFO nova.compute.manager [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Took 2.42 seconds to detach 3 volumes for instance.
Apr 12 07:42:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:36 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:42:36 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:42:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:36 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Deleted allocations for instance 23c2ab3f-ce38-434b-a879-91f43d16f730
Apr 12 07:42:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "23c2ab3f-ce38-434b-a879-91f43d16f730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.848s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:43 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285348.7135773, 23c2ab3f-ce38-434b-a879-91f43d16f730 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:42:43 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] VM Stopped (Lifecycle Event)
Apr 12 07:42:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e9b4e2cf-81c7-442a-95bf-69247eae562b None None] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:42:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:42:53 user nova-compute[82850]: INFO nova.compute.claims [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Claim successful on node user
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:42:53 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:42:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.policy [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:42:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Creating image(s)
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "/opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "/opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "/opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk 1073741824" returned: 0 in 0.050s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Successfully created port: 3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Cannot resize image /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'migration_context' on Instance uuid 4820ef5a-bb6b-4b54-987b-071d51bca7d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Successfully updated port: 3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquired lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-changed-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Refreshing instance network info cache due to event network-changed-3047f54e-67d3-4ca8-8e19-a5d01ba1db57. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Acquiring lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:42:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Updating instance_info_cache with network_info: [{"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Releasing lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Instance network_info: |[{"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Acquired lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Refreshing network info cache for port 3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Start _get_guest_xml network_info=[{"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:42:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:42:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788052455',display_name='tempest-VolumesAdminNegativeTest-server-1788052455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788052455',id=15,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-fpcuwz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:42:54Z,user_data=None,user_id='8de4929e67ed472b90e95066b2c50340',uuid=4820ef5a-bb6b-4b54-987b-071d51bca7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'pci_devices' on Instance uuid 4820ef5a-bb6b-4b54-987b-071d51bca7d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:42:56 user nova-compute[82850]:   <uuid>4820ef5a-bb6b-4b54-987b-071d51bca7d7</uuid>
Apr 12 07:42:56 user nova-compute[82850]:   <name>instance-0000000f</name>
Apr 12 07:42:56 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:42:56 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:42:56 user nova-compute[82850]:   <metadata>
Apr 12 07:42:56 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:42:56 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1788052455</nova:name>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:42:56</nova:creationTime>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:42:56 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:42:56 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:owner>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:user uuid="8de4929e67ed472b90e95066b2c50340">tempest-VolumesAdminNegativeTest-407566417-project-member</nova:user>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:project uuid="19a93f4d88764fd49cd8b2eb9ff1cb8f">tempest-VolumesAdminNegativeTest-407566417</nova:project>
Apr 12 07:42:56 user nova-compute[82850]:       </nova:owner>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:42:56 user nova-compute[82850]:       <nova:ports>
Apr 12 07:42:56 user nova-compute[82850]:         <nova:port uuid="3047f54e-67d3-4ca8-8e19-a5d01ba1db57">
Apr 12 07:42:56 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:42:56 user nova-compute[82850]:         </nova:port>
Apr 12 07:42:56 user nova-compute[82850]:       </nova:ports>
Apr 12 07:42:56 user nova-compute[82850]:     </nova:instance>
Apr 12 07:42:56 user nova-compute[82850]:   </metadata>
Apr 12 07:42:56 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:42:56 user nova-compute[82850]:     <system>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="serial">4820ef5a-bb6b-4b54-987b-071d51bca7d7</entry>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="uuid">4820ef5a-bb6b-4b54-987b-071d51bca7d7</entry>
Apr 12 07:42:56 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:42:56 user nova-compute[82850]:     </system>
Apr 12 07:42:56 user nova-compute[82850]:   </sysinfo>
Apr 12 07:42:56 user nova-compute[82850]:   <os>
Apr 12 07:42:56 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:42:56 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:42:56 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:42:56 user nova-compute[82850]:   </os>
Apr 12 07:42:56 user nova-compute[82850]:   <features>
Apr 12 07:42:56 user nova-compute[82850]:     <acpi/>
Apr 12 07:42:56 user nova-compute[82850]:     <apic/>
Apr 12 07:42:56 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:42:56 user nova-compute[82850]:   </features>
Apr 12 07:42:56 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:42:56 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:42:56 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:42:56 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:42:56 user nova-compute[82850]:   </clock>
Apr 12 07:42:56 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:42:56 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:42:56 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:42:56 user nova-compute[82850]:   </cpu>
Apr 12 07:42:56 user nova-compute[82850]:   <devices>
Apr 12 07:42:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:42:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:42:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk"/>
Apr 12 07:42:56 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:42:56 user nova-compute[82850]:     </disk>
Apr 12 07:42:56 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:42:56 user nova-compute[82850]:       <mac address="fa:16:3e:8f:ea:ea"/>
Apr 12 07:42:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:42:56 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:42:56 user nova-compute[82850]:       <target dev="tap3047f54e-67"/>
Apr 12 07:42:56 user nova-compute[82850]:     </interface>
Apr 12 07:42:56 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:42:56 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/console.log" append="off"/>
Apr 12 07:42:56 user nova-compute[82850]:     </serial>
Apr 12 07:42:56 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:42:56 user nova-compute[82850]:     <video>
Apr 12 07:42:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:42:56 user nova-compute[82850]:     </video>
Apr 12 07:42:56 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:42:56 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:42:56 user nova-compute[82850]:     </rng>
Apr 12 07:42:56 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:42:56 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:42:56 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:42:56 user nova-compute[82850]:     </memballoon>
Apr 12 07:42:56 user nova-compute[82850]:   </devices>
Apr 12 07:42:56 user nova-compute[82850]: </domain>
Apr 12 07:42:56 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788052455',display_name='tempest-VolumesAdminNegativeTest-server-1788052455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788052455',id=15,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-fpcuwz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:42:54Z,user_data=None,user_id='8de4929e67ed472b90e95066b2c50340',uuid=4820ef5a-bb6b-4b54-987b-071d51bca7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG os_vif [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3047f54e-67, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3047f54e-67, col_values=(('external_ids', {'iface-id': '3047f54e-67d3-4ca8-8e19-a5d01ba1db57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ea:ea', 'vm-uuid': '4820ef5a-bb6b-4b54-987b-071d51bca7d7'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:56 user nova-compute[82850]: INFO os_vif [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67')
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] No VIF found with MAC fa:16:3e:8f:ea:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Updated VIF entry in instance network info cache for port 3047f54e-67d3-4ca8-8e19-a5d01ba1db57. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Updating instance_info_cache with network_info: [{"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:42:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Releasing lock "refresh_cache-4820ef5a-bb6b-4b54-987b-071d51bca7d7" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:42:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] No waiting events found dispatching network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:42:58 user nova-compute[82850]: WARNING nova.compute.manager [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received unexpected event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance with vm_state building and task_state spawning.
Apr 12 07:42:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:42:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Terminating instance
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285380.0586417, 4820ef5a-bb6b-4b54-987b-071d51bca7d7 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] VM Resumed (Lifecycle Event)
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Instance spawned successfully.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] No waiting events found dispatching network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:00 user nova-compute[82850]: WARNING nova.compute.manager [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received unexpected event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance with vm_state building and task_state spawning.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285380.0603945, 4820ef5a-bb6b-4b54-987b-071d51bca7d7 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] VM Started (Lifecycle Event)
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Took 6.15 seconds to spawn the instance on the hypervisor.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Took 6.96 seconds to build instance.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.055s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Instance destroyed successfully.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.objects.instance [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'resources' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072053691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1072053691',id=10,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg==',key_name='tempest-keypair-544690587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a790f72405ee4b4ca977ba829dbd8971',ramdisk_id='',reservation_id='r-1o5pyifs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1393321118',owner_user_name='tempest-TaggedAttachmentsTest-1393321118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0082023d624048c796622b4142d89ab6',uuid=62827796-517b-46bd-acb2-98247fa081f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converting VIF {"id": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "address": "fa:16:3e:e2:ee:72", "network": {"id": "7fbf619a-2a3b-4997-ab96-250c026d9f8e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-42610790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a790f72405ee4b4ca977ba829dbd8971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ee8142-11", "ovs_interfaceid": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG os_vif [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49ee8142-11, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:00 user nova-compute[82850]: INFO os_vif [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ee:72,bridge_name='br-int',has_traffic_filtering=True,id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1,network=Network(7fbf619a-2a3b-4997-ab96-250c026d9f8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ee8142-11')
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Deleting instance files /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4_del
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Deletion of /opt/stack/data/nova/instances/62827796-517b-46bd-acb2-98247fa081f4_del complete
Apr 12 07:43:00 user nova-compute[82850]: INFO nova.compute.manager [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 07:43:00 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:43:00 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:43:01 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:01 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Took 1.02 seconds to deallocate network for instance.
Apr 12 07:43:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-deleted-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:01 user nova-compute[82850]: INFO nova.compute.manager [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Neutron deleted interface 49ee8142-11f3-45a6-8a4d-be1968aa1ca1; detaching it from the instance and deleting it from the info cache
Apr 12 07:43:01 user nova-compute[82850]: DEBUG nova.network.neutron [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Detach interface failed, port_id=49ee8142-11f3-45a6-8a4d-be1968aa1ca1, reason: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-unplugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-unplugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:02 user nova-compute[82850]: WARNING nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-unplugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance with vm_state deleted and task_state None.
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Acquiring lock "62827796-517b-46bd-acb2-98247fa081f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "62827796-517b-46bd-acb2-98247fa081f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] No waiting events found dispatching network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:02 user nova-compute[82850]: WARNING nova.compute.manager [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Received unexpected event network-vif-plugged-49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance with vm_state deleted and task_state None.
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:02 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Deleted allocations for instance 62827796-517b-46bd-acb2-98247fa081f4
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "62827796-517b-46bd-acb2-98247fa081f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:02 user nova-compute[82850]: INFO nova.compute.manager [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Terminating instance
Apr 12 07:43:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Instance destroyed successfully.
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'resources' on Instance uuid b71c5ba4-aeff-454c-a89c-0cef7ab13806 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-772784802',display_name='tempest-ServersNegativeTestJSON-server-772784802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-772784802',id=13,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-b04t55eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:24Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=b71c5ba4-aeff-454c-a89c-0cef7ab13806,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "address": "fa:16:3e:90:ea:59", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cb5bbd3-34", "ovs_interfaceid": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG os_vif [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cb5bbd3-34, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:03 user nova-compute[82850]: INFO os_vif [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ea:59,bridge_name='br-int',has_traffic_filtering=True,id=0cb5bbd3-349d-4eac-834b-1bb7aeed5cee,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cb5bbd3-34')
Apr 12 07:43:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Deleting instance files /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806_del
Apr 12 07:43:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Deletion of /opt/stack/data/nova/instances/b71c5ba4-aeff-454c-a89c-0cef7ab13806_del complete
Apr 12 07:43:03 user nova-compute[82850]: INFO nova.compute.manager [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 07:43:03 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:43:03 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-unplugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] No waiting events found dispatching network-vif-unplugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-unplugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Acquiring lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] No waiting events found dispatching network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:04 user nova-compute[82850]: WARNING nova.compute.manager [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received unexpected event network-vif-plugged-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance with vm_state active and task_state deleting.
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:04 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Took 0.57 seconds to deallocate network for instance.
Apr 12 07:43:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:04 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Deleted allocations for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806
Apr 12 07:43:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "b71c5ba4-aeff-454c-a89c-0cef7ab13806" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Received event network-vif-deleted-0cb5bbd3-349d-4eac-834b-1bb7aeed5cee {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:09 user nova-compute[82850]: INFO nova.compute.manager [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Terminating instance
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.objects.instance [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'flavor' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-unplugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] No waiting events found dispatching network-vif-unplugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-unplugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.012s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:09 user nova-compute[82850]: INFO nova.compute.manager [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attaching volume a63f5525-138b-4fd7-8ec1-59c92063ee9e to /dev/vdb
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.utils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb2753-65fd-4758-9a9c-c1a8cc668535]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df6ba4-058f-4850-aaec-702de0fd370e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeee516e-3136-4d8a-a865-96d720eb9136]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e888a5d-5400-4af5-ba69-8ad5608c5552]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Instance destroyed successfully.
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.objects.instance [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'resources' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:09 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[503fa9f7-cd99-4193-84e3-06d60920f0dc]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_brick.utils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating existing volume attachment record: a9c3f476-fd91-4328-a185-b790ad61e006 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-121117445',display_name='tempest-TestVolumeSwap-server-121117445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-121117445',id=8,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuq866s8odsIKE37byvvUyVR3YuvoZgZXYSLaRELlwoAt9hhpQPlm37tUV+pXMWu8zJzK90JzS8xUWF9C/JZP8a9zHIGWrSX9Qk3HRbCHg72zVGm71AkqUtFO0R5xTNFQ==',key_name='tempest-keypair-1332528006',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5fc0e264e047c1b874854907be678e',ramdisk_id='',reservation_id='r-1u7sbqr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-564837731',owner_user_name='tempest-TestVolumeSwap-564837731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9750ae336a14eb3b0bcc849aa67a026',uuid=eee310e4-bed8-405f-bfc6-a6bc3085293d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converting VIF {"id": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "address": "fa:16:3e:6a:52:ac", "network": {"id": "98796542-8a8f-40fb-88df-0af563000659", "bridge": "br-int", "label": "tempest-TestVolumeSwap-671267334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5fc0e264e047c1b874854907be678e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0de1b4f-fa", "ovs_interfaceid": "e0de1b4f-faa3-4c31-8cdd-25dff971246c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG os_vif [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0de1b4f-fa, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:10 user nova-compute[82850]: INFO os_vif [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=e0de1b4f-faa3-4c31-8cdd-25dff971246c,network=Network(98796542-8a8f-40fb-88df-0af563000659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0de1b4f-fa')
Apr 12 07:43:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Deleting instance files /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d_del
Apr 12 07:43:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Deletion of /opt/stack/data/nova/instances/eee310e4-bed8-405f-bfc6-a6bc3085293d_del complete
Apr 12 07:43:10 user nova-compute[82850]: INFO nova.compute.manager [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 07:43:10 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:10 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Took 0.82 seconds to deallocate network for instance.
Apr 12 07:43:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:11 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Deleted allocations for instance eee310e4-bed8-405f-bfc6-a6bc3085293d
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Acquiring lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Lock "eee310e4-bed8-405f-bfc6-a6bc3085293d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] No waiting events found dispatching network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:11 user nova-compute[82850]: WARNING nova.compute.manager [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received unexpected event network-vif-plugged-e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance with vm_state deleted and task_state None.
Apr 12 07:43:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Received event network-vif-deleted-e0de1b4f-faa3-4c31-8cdd-25dff971246c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:12 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:12 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:14 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:14 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:14 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1893573-e541-4ed0-852d-cfd7d886c709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:43:14 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8985ff12-b3d8-4f6f-afcd-f52ec3068ffa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e] added
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5a3947-c75d-46a2-b601-8949b83dc2cf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05755b-8630-4d44-880b-58d41e860fa8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTRaSUqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTRaSUqn" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778223c-9b78-4b84-9600-a3e9bc91693e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTRaSUqn'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f62f3-2aac-42e1-961b-47af8bc8d370]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed459d3-b3e7-417c-8ea0-51628b7d7c3f]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:14 user nova-compute[82850]: INFO nova.compute.manager [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Terminating instance
Apr 12 07:43:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb768551-2895-447d-97e9-b7c0bca4fb8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]
Apr 12 07:43:14 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bf1fce-18c3-482f-9d89-3687f4fcd156]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee0062d-ab4b-4521-80ee-9c48516fffe8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:14 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6158c5-5ed4-4fc3-9fe5-a2392de359d7]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-unplugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] No waiting events found dispatching network-vif-unplugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-unplugged-9e37061f-71da-4cdf-b22b-814cda161f85 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Instance destroyed successfully.
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 98cb3965-b028-474d-90b3-b8c6f33b62a2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841248973',display_name='tempest-TestVolumeBootPattern-server-1841248973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841248973',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ge04i4ag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:42Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=98cb3965-b028-474d-90b3-b8c6f33b62a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "9e37061f-71da-4cdf-b22b-814cda161f85", "address": "fa:16:3e:be:09:fd", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37061f-71", "ovs_interfaceid": "9e37061f-71da-4cdf-b22b-814cda161f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG os_vif [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e37061f-71, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:15 user nova-compute[82850]: INFO os_vif [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:09:fd,bridge_name='br-int',has_traffic_filtering=True,id=9e37061f-71da-4cdf-b22b-814cda161f85,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37061f-71')
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwolJOth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:15 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285380.8138013, 62827796-517b-46bd-acb2-98247fa081f4 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:15 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 62827796-517b-46bd-acb2-98247fa081f4] VM Stopped (Lifecycle Event)
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:43:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-20fdafff-10a1-4a5b-b2e3-4e9824c33f66 None None] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23333393439613735', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333393439613735', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.298s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'flavor' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605095b-5dec-4b0c-b143-9a74bdecef3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:43:16 user nova-compute[82850]: No targets found.
Apr 12 07:43:16 user nova-compute[82850]: iSNS:
Apr 12 07:43:16 user nova-compute[82850]: No targets found.
Apr 12 07:43:16 user nova-compute[82850]: STATIC:
Apr 12 07:43:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45
Apr 12 07:43:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:43:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:16 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:43:16 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:16 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:16 user nova-compute[82850]: FIRMWARE:
Apr 12 07:43:16 user nova-compute[82850]: No targets found.
Apr 12 07:43:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:43:16 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:43:16 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:43:16 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:16 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:43:16 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:43:16 user nova-compute[82850]:   <serial>a63f5525-138b-4fd7-8ec1-59c92063ee9e</serial>
Apr 12 07:43:16 user nova-compute[82850]: </disk>
Apr 12 07:43:16 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f42279-555e-469c-8723-9144f5723fe6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfdb673-d72b-4850-ad0c-aec5b7962565]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:16 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:16 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:16 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:16 user nova-compute[82850]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 (non-flash)
Apr 12 07:43:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c21b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45'): ({'sdf'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdf {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'flavor' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca38cd98-d57f-4ada-b0d7-8b97723489cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa14263-8b51-46c8-86b8-6d1efcb313ee]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdf {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2db2c7-5b4e-46a3-830e-ebcdeff7601d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0b847-594c-4526-85d5-0b050096fc86]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8a4f7-25d1-4238-bcc8-e9cf2c1e8149]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:16 user nova-compute[82850]: INFO nova.compute.manager [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attaching volume 50ebd7de-6dee-4a5b-ba64-d910fb73e897 to /dev/vdb
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[414de64d-efda-4ad3-8708-ab5e364c003d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260]
Apr 12 07:43:16 user nova-compute[82850]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e53974a-e0a4-4fc6-bf20-26819990fd45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2304cc10-5a18-4af4-9ef2-90154e036975]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (711ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:43:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Deleting instance files /opt/stack/data/nova/instances/98cb3965-b028-474d-90b3-b8c6f33b62a2_del
Apr 12 07:43:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Deletion of /opt/stack/data/nova/instances/98cb3965-b028-474d-90b3-b8c6f33b62a2_del complete
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd56d3d-2520-4853-bb15-47743c4eb2e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f56bf-4e9e-40ff-8dc9-49e72e04f0d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: INFO nova.compute.manager [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Took 1.67 seconds to destroy the instance on the hypervisor.
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e5e79-89b4-4bde-90cd-a3b3818dda35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:d5:f3:b1, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d10403-99e9-49c4-8d34-80777dfa12c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:16 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[719667c0-e101-457b-9dbb-a1fd160322b6]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating existing volume attachment record: 7a5c7c33-20b0-48db-a51e-a59cf59813a6 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.011s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Acquiring lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] No waiting events found dispatching network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:17 user nova-compute[82850]: WARNING nova.compute.manager [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received unexpected event network-vif-plugged-9e37061f-71da-4cdf-b22b-814cda161f85 for instance with vm_state active and task_state deleting.
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:17 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Took 0.91 seconds to deallocate network for instance.
Apr 12 07:43:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Received event network-vif-deleted-9e37061f-71da-4cdf-b22b-814cda161f85 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:18 user nova-compute[82850]: INFO nova.compute.manager [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Rebuilding instance
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_requests' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:18 user nova-compute[82850]: INFO nova.compute.manager [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Took 1.00 seconds to detach 1 volumes for instance.
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Deleting volume: 9e53974a-e0a4-4fc6-bf20-26819990fd45 {{(pid=82850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'migration_context' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82850) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285383.576935, b71c5ba4-aeff-454c-a89c-0cef7ab13806 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:18 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] VM Stopped (Lifecycle Event)
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-be67cfdb-db1b-4f5e-abc6-108a54f62d4a None None] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:43:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:19 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "98cb3965-b028-474d-90b3-b8c6f33b62a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.440s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:19 user nova-compute[82850]: WARNING nova.compute.manager [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state rebuilding.
Apr 12 07:43:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance destroyed successfully.
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: INFO nova.compute.manager [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Detaching volume a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:43:19 user nova-compute[82850]: INFO nova.virt.block_device [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attempting to driver detach volume a63f5525-138b-4fd7-8ec1-59c92063ee9e from mountpoint /dev/vdb
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Attempting to detach device vdb from instance 3b7424e4-52aa-4330-a748-006240372716 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:43:19 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:19 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:43:19 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:43:19 user nova-compute[82850]:   <serial>a63f5525-138b-4fd7-8ec1-59c92063ee9e</serial>
Apr 12 07:43:19 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:43:19 user nova-compute[82850]: </disk>
Apr 12 07:43:19 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully detached device vdb from instance 3b7424e4-52aa-4330-a748-006240372716 from the persistent domain config.
Apr 12 07:43:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:19 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[416967f5-d7a6-4567-8148-23553638ca5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:43:19 user nova-compute[82850]: No targets found.
Apr 12 07:43:19 user nova-compute[82850]: iSNS:
Apr 12 07:43:19 user nova-compute[82850]: No targets found.
Apr 12 07:43:19 user nova-compute[82850]: STATIC:
Apr 12 07:43:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:43:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:19 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:43:19 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:19 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:19 user nova-compute[82850]: FIRMWARE:
Apr 12 07:43:19 user nova-compute[82850]: No targets found.
Apr 12 07:43:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:43:19 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:43:19 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c7f4c-7e79-434f-ad85-e183f8e021e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2e906-fb4a-4a14-9bc2-709179764bb8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:19 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:19 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:19 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c2a9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d17a8ef-6858-42b8-a3be-e61350442725]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45cd58d-cf8a-4a98-a15d-46961f9146d5]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a760872-2318-44f3-ac8f-7d3416db836f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e751009e-1c32-47eb-a2cf-01282fcbf4d9]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:43:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f178c6f-c20e-4639-9b68-eb945896d376]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb412f9a-0b08-40cd-9ea7-d18d2d4510c7]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]
Apr 12 07:43:20 user nova-compute[82850]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e8cb8-abb4-4470-af14-aa515d600dba]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (454ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:20 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:20 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:20 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=26.386669158935547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:43:20 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'info_cache' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:21 user nova-compute[82850]: WARNING nova.compute.manager [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state rebuilding.
Apr 12 07:43:21 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance destroyed successfully.
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24db70b-54, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:21 user nova-compute[82850]: INFO os_vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:21 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62918f7-fb7b-47bb-aaff-3a994ff6950a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:43:21 user nova-compute[82850]: No targets found.
Apr 12 07:43:21 user nova-compute[82850]: iSNS:
Apr 12 07:43:21 user nova-compute[82850]: No targets found.
Apr 12 07:43:21 user nova-compute[82850]: STATIC:
Apr 12 07:43:21 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:43:21 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:21 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:21 user nova-compute[82850]: FIRMWARE:
Apr 12 07:43:21 user nova-compute[82850]: No targets found.
Apr 12 07:43:21 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:43:21 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:43:21 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b51362-c1a9-431b-9fef-16bb998f12e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ad874a-1cb8-4305-b28c-ee3bac71747c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:21 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:21 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c8aa8c0>, {}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (84ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:43:21 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Deleting instance files /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_del
Apr 12 07:43:21 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Deletion of /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_del complete
Apr 12 07:43:21 user nova-compute[82850]: INFO nova.virt.block_device [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Booting with volume a63f5525-138b-4fd7-8ec1-59c92063ee9e at /dev/vdb
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.utils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f737a-c529-4c37-9e2e-7485572b549f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88dd09-bfa3-4ef5-bffe-4a12bb232bb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dfa6b6-64e3-4761-990b-9060f2018b94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264e793-eebc-4520-be1e-d8e78882e485]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:21 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[857aa188-5805-4885-a6c9-0dccdac01756]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.utils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating existing volume attachment record: c45be933-6ffc-4161-b6e6-103558f9f29a {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:21 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:21 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:21 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[648281ea-75ae-4637-97c3-6d42c643f70c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:43:21 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e51813-ce20-4843-95e4-fd2007495a95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897] added
Apr 12 07:43:21 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c1381-592d-402c-a107-43d5b457a27d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332c3eb-9d3f-42be-a79c-19d6ddac1933]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWkCJuQm {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWkCJuQm" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e370ff7-4b41-454e-b1ee-fed7878aa503]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWkCJuQm'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[941da5af-51af-4ad6-9737-a3c312ef985b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc986af-8de1-463d-8f42-425b8625a6d5]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance destroyed successfully.
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'resources' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40ca8897-71, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c56e4-71da-4995-aec8-8995319c2287]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260]
Apr 12 07:43:22 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: INFO os_vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:43:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:22 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a319a8-286a-4645-b08f-6b9f0c7859bc]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af8332-b6e3-4925-b136-59ee2c3639b5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:22 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:22 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36981609-c706-4a57-95a7-2834e4259923]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:43:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26633646133393530', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646133393530', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.079s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'flavor' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cbabe5-8337-44dc-aba5-25d612678c70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:43:23 user nova-compute[82850]: No targets found.
Apr 12 07:43:23 user nova-compute[82850]: iSNS:
Apr 12 07:43:23 user nova-compute[82850]: No targets found.
Apr 12 07:43:23 user nova-compute[82850]: STATIC:
Apr 12 07:43:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:43:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:43:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:43:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:43:23 user nova-compute[82850]: FIRMWARE:
Apr 12 07:43:23 user nova-compute[82850]: No targets found.
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:43:23 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:43:23 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:43:23 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:23 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:43:23 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:43:23 user nova-compute[82850]:   <serial>50ebd7de-6dee-4a5b-ba64-d910fb73e897</serial>
Apr 12 07:43:23 user nova-compute[82850]: </disk>
Apr 12 07:43:23 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae8e0c-5979-40a3-856e-2eb954ceb962]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc202f32-27ba-48a9-8e9f-4c37f1678cc1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:23 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:23 user nova-compute[82850]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c21b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f'): ({'sde'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Removing single pathed devices sde {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af4a69-651f-47b3-93a5-a38574efe1cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f99384-7659-4091-b640-1a2c4d52dad0]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flushing IO for device /dev/sde {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[619c2fb2-7388-470d-a246-48c325f09db7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cabea79-b7a5-407c-9ef1-cd42d0a3b4b2]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253cf5b-defe-4ca4-a4ed-67fbe010dab9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f221def0-49ec-4525-af99-6f676572d3e4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]
Apr 12 07:43:23 user nova-compute[82850]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd428f4-5f0e-4c60-96cd-093f48f1b031]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== disconnect_volume: return (1394ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start _get_guest_xml network_info=[{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'serial': 'd264d7ac-e4d5-48b7-b5f8-11b463caef9f'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '6f484932-d722-4989-94e4-e62e73007481', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'numa_topology' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'vcpu_model' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:23 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dfb082-56d3-41d8-a2f1-0beac89544d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:43:23 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No VIF found with MAC fa:16:3e:71:22:82, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11ff8f-7304-4e7c-8f4f-d63df2183dbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f] added
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86999d-fac5-4487-ad88-b1da8048df31]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe05190-534c-413e-8c57-bcddfab10619]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrqzIwHE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrqzIwHE" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9c40eb-2a5e-488e-8dfb-d781f9202ff9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrqzIwHE'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61796a9c-d1da-45a7-8f6c-10567077c11f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.562s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f356e3d-4d72-4e84-ae54-01fcc536fbbc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:24 user nova-compute[82850]: INFO nova.compute.manager [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Rescuing
Apr 12 07:43:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285389.9354448, eee310e4-bed8-405f-bfc6-a6bc3085293d => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:24 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] VM Stopped (Lifecycle Event)
Apr 12 07:43:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-60ad48bc-fdda-41a0-b218-b07b3c0b5dcb None None] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --login" returned: 0 in 1.077s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e333a12-53f1-49cf-a8f1-37381d93880b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]
Apr 12 07:43:24 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.075s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261d8dc-d528-4da1-a1a9-f535e33a44f1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2af7e30-2e34-492e-84f7-08fffe92a9dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:25 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:25 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:25 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:25 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.449s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf58af7-b5d4-4c87-a62e-4b721f6eab5c]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:25 user nova-compute[82850]: WARNING nova.compute.manager [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state active and task_state rescuing.
Apr 12 07:43:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.480s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== connect_volume: return (2482ms) {'type': 'block', 'scsi_wwn': '26436323238633838', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436323238633838', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'pci_devices' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:43:26 user nova-compute[82850]:   <uuid>f79ca8ec-41b5-4b60-882f-d74d906fb8e6</uuid>
Apr 12 07:43:26 user nova-compute[82850]:   <name>instance-00000006</name>
Apr 12 07:43:26 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:43:26 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:43:26 user nova-compute[82850]:   <metadata>
Apr 12 07:43:26 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:43:26 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeTestJSON-server-1794309151</nova:name>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:43:23</nova:creationTime>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:43:26 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:43:26 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:owner>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:user uuid="a555fa5e6680420e80fcc925a7540806">tempest-AttachVolumeTestJSON-1353175840-project-member</nova:user>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:project uuid="f7915d29fb124c838093eba0ee6cb69c">tempest-AttachVolumeTestJSON-1353175840</nova:project>
Apr 12 07:43:26 user nova-compute[82850]:       </nova:owner>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:43:26 user nova-compute[82850]:       <nova:ports>
Apr 12 07:43:26 user nova-compute[82850]:         <nova:port uuid="40ca8897-7180-4ef1-91f2-29b18afbcc25">
Apr 12 07:43:26 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:43:26 user nova-compute[82850]:         </nova:port>
Apr 12 07:43:26 user nova-compute[82850]:       </nova:ports>
Apr 12 07:43:26 user nova-compute[82850]:     </nova:instance>
Apr 12 07:43:26 user nova-compute[82850]:   </metadata>
Apr 12 07:43:26 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:43:26 user nova-compute[82850]:     <system>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="serial">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="uuid">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:43:26 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:43:26 user nova-compute[82850]:     </system>
Apr 12 07:43:26 user nova-compute[82850]:   </sysinfo>
Apr 12 07:43:26 user nova-compute[82850]:   <os>
Apr 12 07:43:26 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:43:26 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:43:26 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:43:26 user nova-compute[82850]:   </os>
Apr 12 07:43:26 user nova-compute[82850]:   <features>
Apr 12 07:43:26 user nova-compute[82850]:     <acpi/>
Apr 12 07:43:26 user nova-compute[82850]:     <apic/>
Apr 12 07:43:26 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:43:26 user nova-compute[82850]:   </features>
Apr 12 07:43:26 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:43:26 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:43:26 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:43:26 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:43:26 user nova-compute[82850]:   </clock>
Apr 12 07:43:26 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:43:26 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:43:26 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:43:26 user nova-compute[82850]:   </cpu>
Apr 12 07:43:26 user nova-compute[82850]:   <devices>
Apr 12 07:43:26 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:43:26 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:43:26 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk"/>
Apr 12 07:43:26 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:43:26 user nova-compute[82850]:     </disk>
Apr 12 07:43:26 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:43:26 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:26 user nova-compute[82850]:       <source dev="/dev/sdc"/>
Apr 12 07:43:26 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:43:26 user nova-compute[82850]:       <serial>d264d7ac-e4d5-48b7-b5f8-11b463caef9f</serial>
Apr 12 07:43:26 user nova-compute[82850]:     </disk>
Apr 12 07:43:26 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:43:26 user nova-compute[82850]:       <mac address="fa:16:3e:b7:ec:08"/>
Apr 12 07:43:26 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:26 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:43:26 user nova-compute[82850]:       <target dev="tap40ca8897-71"/>
Apr 12 07:43:26 user nova-compute[82850]:     </interface>
Apr 12 07:43:26 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:43:26 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/console.log" append="off"/>
Apr 12 07:43:26 user nova-compute[82850]:     </serial>
Apr 12 07:43:26 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:43:26 user nova-compute[82850]:     <video>
Apr 12 07:43:26 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:26 user nova-compute[82850]:     </video>
Apr 12 07:43:26 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:43:26 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:43:26 user nova-compute[82850]:     </rng>
Apr 12 07:43:26 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:43:26 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:43:26 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:43:26 user nova-compute[82850]:     </memballoon>
Apr 12 07:43:26 user nova-compute[82850]:   </devices>
Apr 12 07:43:26 user nova-compute[82850]: </domain>
Apr 12 07:43:26 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance destroyed successfully.
Apr 12 07:43:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attempting a stable device rescue
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'trusted_certs' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:43:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Creating image(s)
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.166s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:43:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.767s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Cannot resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'migration_context' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG os_vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40ca8897-71, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40ca8897-71, col_values=(('external_ids', {'iface-id': '40ca8897-7180-4ef1-91f2-29b18afbcc25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ec:08', 'vm-uuid': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:27 user nova-compute[82850]: INFO os_vif [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.part --force-share --output=json" returned: 0 in 0.171s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.virt.images [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 605c6427-e907-43e2-b4e9-f596062d8170 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.part /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:43:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating image(s)
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.part /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.converted" returned: 0 in 0.278s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING nova.compute.manager [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state active and task_state rescuing.
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.171s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.430s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.209s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93 --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93,backing_fmt=raw /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk 1073741824" returned: 0 in 0.080s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93,backing_fmt=raw /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue" returned: 0 in 0.078s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "8a438427d9d1cea2d68f3e10f53d6013a25f9c93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'migration_context' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start _get_guest_xml network_info=[{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "vif_mac": "fa:16:3e:71:22:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '605c6427-e907-43e2-b4e9-f596062d8170', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '69aeabdc-65e3-4af2-9f8b-3699778c6b89', 'attached_at': '', 'detached_at': '', 'volume_id': '50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'serial': '50ebd7de-6dee-4a5b-ba64-d910fb73e897'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '7a5c7c33-20b0-48db-a51e-a59cf59813a6', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'resources' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'numa_topology' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:28 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.176s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e13ff-a259-4c40-a3d6-0a89f156a91e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xWkCJuQm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 07:43:28 user nova-compute[82850]: node.name = iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:43:28 user nova-compute[82850]: node.tpgt = -1
Apr 12 07:43:28 user nova-compute[82850]: node.startup = automatic
Apr 12 07:43:28 user nova-compute[82850]: node.leading_login = No
Apr 12 07:43:28 user nova-compute[82850]: iface.iscsi_ifacename = default
Apr 12 07:43:28 user nova-compute[82850]: iface.net_ifacename = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.ipaddress = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.prefix_len = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.hwaddress = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.transport_name = tcp
Apr 12 07:43:28 user nova-compute[82850]: iface.initiatorname = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.vlan_id = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.vlan_priority = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.vlan_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.iface_num = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.mtu = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.port = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.bootproto = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.subnet_mask = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.gateway = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_alt_client_id = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_dns = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_learn_iqn = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_vendor_id_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_vendor_id = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.dhcp_slp_da = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.fragmentation = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.gratuitous_arp = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.incoming_forwarding = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.tos_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.tos = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.ttl = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.delayed_ack = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.tcp_nagle = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.tcp_wsf_state = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.tcp_wsf = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.tcp_timer_scale = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.tcp_timestamp = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.redirect = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.def_task_mgmt_timeout = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.header_digest = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.data_digest = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.immediate_data = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.initial_r2t = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.data_seq_inorder = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.data_pdu_inorder = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.erl = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.max_receive_data_len = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.first_burst_len = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.max_outstanding_r2t = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.max_burst_len = 0
Apr 12 07:43:28 user nova-compute[82850]: iface.chap_auth = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.bidi_chap = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.strict_login_compliance = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.discovery_auth = <empty>
Apr 12 07:43:28 user nova-compute[82850]: iface.discovery_logout = <empty>
Apr 12 07:43:28 user nova-compute[82850]: node.discovery_address = <empty>
Apr 12 07:43:28 user nova-compute[82850]: node.discovery_port = 0
Apr 12 07:43:28 user nova-compute[82850]: node.discovery_type = static
Apr 12 07:43:28 user nova-compute[82850]: node.session.initial_cmdsn = 0
Apr 12 07:43:28 user nova-compute[82850]: node.session.initial_login_retry_max = 8
Apr 12 07:43:28 user nova-compute[82850]: node.session.xmit_thread_priority = -20
Apr 12 07:43:28 user nova-compute[82850]: node.session.cmds_max = 128
Apr 12 07:43:28 user nova-compute[82850]: node.session.queue_depth = 32
Apr 12 07:43:28 user nova-compute[82850]: node.session.nr_sessions = 1
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.authmethod = CHAP
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.username = xWkCJuQm
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.password = ***
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.username_in = <empty>
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.password_in = <empty>
Apr 12 07:43:28 user nova-compute[82850]: node.session.auth.chap_algs = MD5
Apr 12 07:43:28 user nova-compute[82850]: node.session.timeo.replacement_timeout = 120
Apr 12 07:43:28 user nova-compute[82850]: node.session.err_timeo.abort_timeout = 15
Apr 12 07:43:28 user nova-compute[82850]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 07:43:28 user nova-compute[82850]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 07:43:28 user nova-compute[82850]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.FastAbort = Yes
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.InitialR2T = No
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.ImmediateData = Yes
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.MaxConnections = 1
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 07:43:28 user nova-compute[82850]: node.session.iscsi.ERL = 0
Apr 12 07:43:28 user nova-compute[82850]: node.session.scan = manual
Apr 12 07:43:28 user nova-compute[82850]: node.session.reopen_max = 0
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].address = 172.16.0.220
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].port = 3260
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].startup = manual
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].tcp.window_size = 524288
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].tcp.type_of_service = 0
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].timeo.logout_timeout = 15
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].timeo.login_timeout = 15
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].timeo.auth_timeout = 45
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.DataDigest = None
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.IFMarker = No
Apr 12 07:43:28 user nova-compute[82850]: node.conn[0].iscsi.OFMarker = No
Apr 12 07:43:28 user nova-compute[82850]: # END RECORD
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2e98ce-8174-48ab-97ec-f6aa7b176b4a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a842274-6b0b-47db-9d1a-11cfbab4ca53]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWkCJuQm {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWkCJuQm" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67921dc2-822f-4816-bf4d-5e90bc602ba8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWkCJuQm'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9530fe-e2bf-4822-9300-4469138b1128]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Cannot resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Ensure instance console log exists: /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start _get_guest_xml network_info=[{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b7424e4-52aa-4330-a748-006240372716', 'attached_at': '', 'detached_at': '', 'volume_id': 'a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'serial': 'a63f5525-138b-4fd7-8ec1-59c92063ee9e'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'c45be933-6ffc-4161-b6e6-103558f9f29a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d479ee7f-e4b5-45df-b2f2-ac4044f130e2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:28 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:28 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 07:43:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[660634ad-fad1-45e6-a427-1d8fe75dd601]: (4, ('0 0 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '26633646133393530', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646133393530', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:43:28 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2050028382',display_name='tempest-ServerStableDeviceRescueTest-server-2050028382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2050028382',id=7,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqw+fRFEXzo2E8zYD8tNpcWZ3Dbiukx9cAFsZUU+hROJOSEqpmsx5UgbhAUOur9dqTbsQ7BQg01ufaydX8WNt+5So3ZMdUF8LLxFa/deh6yQ8CHMyjzOmnF4ex9Z+eEQQ==',key_name='tempest-keypair-777808843',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3578114ca9476ca280abc2e4f83b11',ramdisk_id='',reservation_id='r-hrepuju0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-473420304',owner_user_name='tempest-ServerStableDeviceRescueTest-473420304-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d67cdd754c467dbe2760ede6f4218d',uuid=69aeabdc-65e3-4af2-9f8b-3699778c6b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "vif_mac": "fa:16:3e:71:22:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converting VIF {"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "vif_mac": "fa:16:3e:71:22:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'pci_devices' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:43:28 user nova-compute[82850]:   <uuid>69aeabdc-65e3-4af2-9f8b-3699778c6b89</uuid>
Apr 12 07:43:28 user nova-compute[82850]:   <name>instance-00000007</name>
Apr 12 07:43:28 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:43:28 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:43:28 user nova-compute[82850]:   <metadata>
Apr 12 07:43:28 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:43:28 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2050028382</nova:name>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:43:28</nova:creationTime>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:43:28 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:43:28 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:owner>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:user uuid="b3d67cdd754c467dbe2760ede6f4218d">tempest-ServerStableDeviceRescueTest-473420304-project-member</nova:user>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:project uuid="bc3578114ca9476ca280abc2e4f83b11">tempest-ServerStableDeviceRescueTest-473420304</nova:project>
Apr 12 07:43:28 user nova-compute[82850]:       </nova:owner>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:43:28 user nova-compute[82850]:       <nova:ports>
Apr 12 07:43:28 user nova-compute[82850]:         <nova:port uuid="0b334cc7-e101-4fdc-9a60-98cf9c11d7ca">
Apr 12 07:43:28 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 07:43:28 user nova-compute[82850]:         </nova:port>
Apr 12 07:43:28 user nova-compute[82850]:       </nova:ports>
Apr 12 07:43:28 user nova-compute[82850]:     </nova:instance>
Apr 12 07:43:28 user nova-compute[82850]:   </metadata>
Apr 12 07:43:28 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:43:28 user nova-compute[82850]:     <system>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="serial">69aeabdc-65e3-4af2-9f8b-3699778c6b89</entry>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="uuid">69aeabdc-65e3-4af2-9f8b-3699778c6b89</entry>
Apr 12 07:43:28 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:43:28 user nova-compute[82850]:     </system>
Apr 12 07:43:28 user nova-compute[82850]:   </sysinfo>
Apr 12 07:43:28 user nova-compute[82850]:   <os>
Apr 12 07:43:28 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:43:28 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:43:28 user nova-compute[82850]:   </os>
Apr 12 07:43:28 user nova-compute[82850]:   <features>
Apr 12 07:43:28 user nova-compute[82850]:     <acpi/>
Apr 12 07:43:28 user nova-compute[82850]:     <apic/>
Apr 12 07:43:28 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:43:28 user nova-compute[82850]:   </features>
Apr 12 07:43:28 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:43:28 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:43:28 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:43:28 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:43:28 user nova-compute[82850]:   </clock>
Apr 12 07:43:28 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:43:28 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:43:28 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:43:28 user nova-compute[82850]:   </cpu>
Apr 12 07:43:28 user nova-compute[82850]:   <devices>
Apr 12 07:43:28 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:43:28 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:43:28 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk"/>
Apr 12 07:43:28 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:43:28 user nova-compute[82850]:     </disk>
Apr 12 07:43:28 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:43:28 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:28 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:43:28 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:43:28 user nova-compute[82850]:       <serial>50ebd7de-6dee-4a5b-ba64-d910fb73e897</serial>
Apr 12 07:43:28 user nova-compute[82850]:     </disk>
Apr 12 07:43:28 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:43:28 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:43:28 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue"/>
Apr 12 07:43:28 user nova-compute[82850]:       <target dev="vdc" bus="virtio"/>
Apr 12 07:43:28 user nova-compute[82850]:       <boot order="1"/>
Apr 12 07:43:28 user nova-compute[82850]:     </disk>
Apr 12 07:43:28 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:43:28 user nova-compute[82850]:       <mac address="fa:16:3e:71:22:82"/>
Apr 12 07:43:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:28 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:43:28 user nova-compute[82850]:       <target dev="tap0b334cc7-e1"/>
Apr 12 07:43:28 user nova-compute[82850]:     </interface>
Apr 12 07:43:28 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:43:28 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/console.log" append="off"/>
Apr 12 07:43:28 user nova-compute[82850]:     </serial>
Apr 12 07:43:28 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:43:28 user nova-compute[82850]:     <video>
Apr 12 07:43:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:28 user nova-compute[82850]:     </video>
Apr 12 07:43:28 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:43:28 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:43:28 user nova-compute[82850]:     </rng>
Apr 12 07:43:28 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:43:28 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:43:28 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:43:28 user nova-compute[82850]:     </memballoon>
Apr 12 07:43:28 user nova-compute[82850]:   </devices>
Apr 12 07:43:28 user nova-compute[82850]: </domain>
Apr 12 07:43:28 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3b487-668f-46c6-9582-15a2ad945941]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:43:28 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance destroyed successfully.
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e666e0-8611-45c8-a685-126d3a185434]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e] added
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d23eab-a83d-4e4c-bdb2-5db24cd12501]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] No VIF found with MAC fa:16:3e:71:22:82, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc6b7b-d1eb-4bb7-b3b4-e57b609b6872]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTRaSUqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTRaSUqn" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb783069-6c4d-446f-83d2-b311d096398a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTRaSUqn'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff89b6-57a0-4b25-8b11-50356d31cbe6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[396dc1b8-9d54-4058-ac29-775549a45123]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:28 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:28 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc393b37-4693-4dd3-854b-5dd97a284b61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]
Apr 12 07:43:29 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.
Apr 12 07:43:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[484fa70a-4efc-4cf4-9395-90a27c134cf5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c64d4d-adc8-4851-9d14-f15894c3c0e6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:29 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:29 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:43:29 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:43:29 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:43:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba2dec-dc6c-43c8-a744-a87e4a11f5c0]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:29 user nova-compute[82850]: WARNING nova.compute.manager [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state powering-on.
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23333393439613735', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333393439613735', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:43:30 user nova-compute[82850]:   <uuid>3b7424e4-52aa-4330-a748-006240372716</uuid>
Apr 12 07:43:30 user nova-compute[82850]:   <name>instance-00000004</name>
Apr 12 07:43:30 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:43:30 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:43:30 user nova-compute[82850]:   <metadata>
Apr 12 07:43:30 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:43:30 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-926530387</nova:name>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:43:28</nova:creationTime>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:43:30 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:43:30 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:owner>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:43:30 user nova-compute[82850]:       </nova:owner>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:43:30 user nova-compute[82850]:       <nova:ports>
Apr 12 07:43:30 user nova-compute[82850]:         <nova:port uuid="d24db70b-543b-4549-8c33-b8276a776c3d">
Apr 12 07:43:30 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:43:30 user nova-compute[82850]:         </nova:port>
Apr 12 07:43:30 user nova-compute[82850]:       </nova:ports>
Apr 12 07:43:30 user nova-compute[82850]:     </nova:instance>
Apr 12 07:43:30 user nova-compute[82850]:   </metadata>
Apr 12 07:43:30 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:43:30 user nova-compute[82850]:     <system>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="serial">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="uuid">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:43:30 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:43:30 user nova-compute[82850]:     </system>
Apr 12 07:43:30 user nova-compute[82850]:   </sysinfo>
Apr 12 07:43:30 user nova-compute[82850]:   <os>
Apr 12 07:43:30 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:43:30 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:43:30 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:43:30 user nova-compute[82850]:   </os>
Apr 12 07:43:30 user nova-compute[82850]:   <features>
Apr 12 07:43:30 user nova-compute[82850]:     <acpi/>
Apr 12 07:43:30 user nova-compute[82850]:     <apic/>
Apr 12 07:43:30 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:43:30 user nova-compute[82850]:   </features>
Apr 12 07:43:30 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:43:30 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:43:30 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:43:30 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:43:30 user nova-compute[82850]:   </clock>
Apr 12 07:43:30 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:43:30 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:43:30 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:43:30 user nova-compute[82850]:   </cpu>
Apr 12 07:43:30 user nova-compute[82850]:   <devices>
Apr 12 07:43:30 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:43:30 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:43:30 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk"/>
Apr 12 07:43:30 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:43:30 user nova-compute[82850]:     </disk>
Apr 12 07:43:30 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:43:30 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:43:30 user nova-compute[82850]:       <source dev="/dev/sdd"/>
Apr 12 07:43:30 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:43:30 user nova-compute[82850]:       <serial>a63f5525-138b-4fd7-8ec1-59c92063ee9e</serial>
Apr 12 07:43:30 user nova-compute[82850]:     </disk>
Apr 12 07:43:30 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:43:30 user nova-compute[82850]:       <mac address="fa:16:3e:d5:f3:b1"/>
Apr 12 07:43:30 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:30 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:43:30 user nova-compute[82850]:       <target dev="tapd24db70b-54"/>
Apr 12 07:43:30 user nova-compute[82850]:     </interface>
Apr 12 07:43:30 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:43:30 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log" append="off"/>
Apr 12 07:43:30 user nova-compute[82850]:     </serial>
Apr 12 07:43:30 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:43:30 user nova-compute[82850]:     <video>
Apr 12 07:43:30 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:43:30 user nova-compute[82850]:     </video>
Apr 12 07:43:30 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:43:30 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:43:30 user nova-compute[82850]:     </rng>
Apr 12 07:43:30 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:43:30 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:43:30 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:43:30 user nova-compute[82850]:     </memballoon>
Apr 12 07:43:30 user nova-compute[82850]:   </devices>
Apr 12 07:43:30 user nova-compute[82850]: </domain>
Apr 12 07:43:30 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG os_vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24db70b-54, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd24db70b-54, col_values=(('external_ids', {'iface-id': 'd24db70b-543b-4549-8c33-b8276a776c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f3:b1', 'vm-uuid': '3b7424e4-52aa-4330-a748-006240372716'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: INFO os_vif [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:d5:f3:b1, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285395.643741, 98cb3965-b028-474d-90b3-b8c6f33b62a2 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:30 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] VM Stopped (Lifecycle Event)
Apr 12 07:43:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-758891f1-5d5e-4fc1-bfb8-84da2a50a812 None None] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:31 user nova-compute[82850]: WARNING nova.compute.manager [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state active and task_state rescuing.
Apr 12 07:43:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:31 user nova-compute[82850]: WARNING nova.compute.manager [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state powering-on.
Apr 12 07:43:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:33 user nova-compute[82850]: WARNING nova.compute.manager [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state active and task_state rescuing.
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285413.3793406, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:33 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Resumed (Lifecycle Event)
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:43:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance rebooted successfully.
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:33 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285413.3808298, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:33 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Started (Lifecycle Event)
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:33 user nova-compute[82850]: WARNING nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state rebuild_spawning.
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:43:33 user nova-compute[82850]: WARNING nova.compute.manager [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state rebuild_spawning.
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285399.2909963, 3b7424e4-52aa-4330-a748-006240372716 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:34 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Stopped (Lifecycle Event)
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4869b784-cf7a-4a53-ac4c-84103cee4453 None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 69aeabdc-65e3-4af2-9f8b-3699778c6b89 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285414.776774, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:34 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Resumed (Lifecycle Event)
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:34 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285414.779874, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:34 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Started (Lifecycle Event)
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285415.364741, 3b7424e4-52aa-4330-a748-006240372716 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:35 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Resumed (Lifecycle Event)
Apr 12 07:43:35 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance spawned successfully.
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:43:35 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285415.3648455, 3b7424e4-52aa-4330-a748-006240372716 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:43:35 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Started (Lifecycle Event)
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:43:35 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82850) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 07:43:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.105s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:43:45 user nova-compute[82850]: INFO nova.compute.claims [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Claim successful on node user
Apr 12 07:43:45 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:43:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:43:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:43:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:43:46 user nova-compute[82850]: INFO nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Booting with volume a2053ea8-adbe-41b6-9586-66df339c74fe at /dev/vda
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG nova.policy [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44989267-16d6-468a-946b-7674dbdf1c93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[993db03f-ead5-42f4-a25e-baba69a8379b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce50fa4-0aa1-4b57-8749-333f961e283e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5eaab-28b8-4db1-a725-4640c43474c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:46 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ccf325-e480-4f44-ba0a-3f2d35e24f04]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:46 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating existing volume attachment record: 9f4a15f7-1cf8-47ed-8fb8-cc7c6bcecd7e {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully created port: 9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:43:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully created port: ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:43:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully created port: 3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:43:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully created port: b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:43:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:50 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully created port: 54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: 9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-9e1d8af4-ee87-40f8-b586-d000e0fa6653. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port 9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:43:52 user nova-compute[82850]: INFO nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Booting with volume 713f4c6b-831b-4ecd-b993-2071b2c76652 at /dev/vdb
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[241b8692-f4c4-4680-833f-1608c5bb213d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3df7a1-67b1-4ac5-83e3-a607f08ed19a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48dcff9-d7f8-4548-84dc-66678da4b166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[303acd03-b974-465c-a4a7-6be9ad552aa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:52 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f402bb52-16c9-44e1-9c71-b4295339b9a5]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating existing volume attachment record: c3c44c50-c109-41ac-887d-640036f8e974 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: 7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-7d15bdba-2895-4995-93c4-a687e1b18ae7. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port 7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:43:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: 3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:57 user nova-compute[82850]: INFO nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Booting with volume 739007bc-1202-495e-a5a1-67750ec8ad7e at /dev/vdc
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cfa0f9-239d-4e93-9d79-9eb21ff67e6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb1696-449f-4bc2-9617-85c9f1105d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f946db-228c-4d0f-a298-4e1f76161065]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c22f8b-f58a-4e00-b186-435d4ad2e146]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:43:58 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d6391-c5b3-4492-80ab-b67a19ba1556]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG os_brick.utils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating existing volume attachment record: 19fe03d9-bedd-4d4a-aec5-7ed1f2574206 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-3c6de623-6a72-4ab8-a405-d9ffabab1f21. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port 3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:43:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Successfully updated port: 54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:43:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:44:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-b7143159-bbbd-45e7-a085-faf5e834569d. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:44:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:44:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Creating image(s)
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Ensure instance console log exists: /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance network_info: |[{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Start _get_guest_xml network_info=[{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfUtWRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32a42e95-630c-43a0-9217-2fc72f859f47', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2053ea8-adbe-41b6-9586-66df339c74fe', 'serial': 'a2053ea8-adbe-41b6-9586-66df339c74fe'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '9f4a15f7-1cf8-47ed-8fb8-cc7c6bcecd7e', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdGsUHSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32a42e95-630c-43a0-9217-2fc72f859f47', 'attached_at': '', 'detached_at': '', 'volume_id': '713f4c6b-831b-4ecd-b993-2071b2c76652', 'serial': '713f4c6b-831b-4ecd-b993-2071b2c76652'}, 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'c3c44c50-c109-41ac-887d-640036f8e974', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJxMVQZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32a42e95-630c-43a0-9217-2fc72f859f47', 'attached_at': '', 'detached_at': '', 'volume_id': '739007bc-1202-495e-a5a1-67750ec8ad7e', 'serial': '739007bc-1202-495e-a5a1-67750ec8ad7e'}, 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '19fe03d9-bedd-4d4a-aec5-7ed1f2574206', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfUtWRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:44:03 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:03 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:03 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08caf29-9664-49ec-881e-d2ea4ec5e211]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:44:03 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1f1c70-91bb-436a-bac3-6cf7f62eb8ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe] added
Apr 12 07:44:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e45350-6d10-4670-8ede-805d73e43348]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.075s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd72319-4d1e-4806-aa26-9b1fbd87ef19]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfUtWRgE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfUtWRgE" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f77f857-ec28-4ca1-aa74-f560c86b0189]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfUtWRgE'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f7170-f98c-4b3b-8941-98a90668fa97]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924f69c-9588-46b0-a456-6fb3d8b9b4d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd45ac-12d0-45a1-a3a1-c4f7c465442f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260]
Apr 12 07:44:04 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260] successful.
Apr 12 07:44:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8292ae-ac33-4249-a7d6-b3153a16e37a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b589281-ea8f-4c06-9f64-7eeb7751d6f8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:04 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddf53e-44c8-4df3-953f-edc0a65d2435]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updated VIF entry in instance network info cache for port b7143159-bbbd-45e7-a085-faf5e834569d. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-54ea6af7-6239-4259-82dc-87e23894017a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port 54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updated VIF entry in instance network info cache for port 54ea6af7-6239-4259-82dc-87e23894017a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfUtWRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23034663838353834', 'path': '/dev/sde'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663838353834', 'path': '/dev/sde'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdGsUHSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:44:05 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:05 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:05 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d030d2b-90f7-4996-9ad7-541b11e41e03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:44:05 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0de9d43-7601-4d5c-b304-f3dfc2701185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652] added
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8aaa06-b568-40f6-b735-97ba322c511e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9dcca8-e96c-4300-8a9c-324119a9f862]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdGsUHSA {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdGsUHSA" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66021ba-3161-4d51-b0bd-aaad9b0362ed]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdGsUHSA'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[219737fc-0634-4c95-b3bb-8bac6e7184b7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e41bc-d924-49a9-b861-08383f137b47]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede88f65-4145-43b0-b98d-b1ecfdbc8fbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260]
Apr 12 07:44:05 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260] successful.
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4701c-8811-4865-aa0f-194c3751eabd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc725b-f967-4c20-a643-aee2178b93ce]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:05 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c139b7d7-d55a-44e4-9907-7b133a762b28]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:44:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdGsUHSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26234666135396637', 'path': '/dev/sdf'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234666135396637', 'path': '/dev/sdf'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJxMVQZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:44:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:06 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1bafbb-6cd6-4600-ada5-33609c411f7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:44:06 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3748110-c7a8-42b3-9878-534879fb316b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e] added
Apr 12 07:44:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d7bb65-6325-4c98-a5cb-c89633bdd10f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ec8b4-d389-40bd-9af0-019c7a7cdc04]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJxMVQZK {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJxMVQZK" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b343f-5f6f-4938-87a9-1be561a42890]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PJxMVQZK'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4945015c-fdcd-44c9-8244-79aa714f18a2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a6142-21ec-401f-9b79-6595b9c9f590]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:06 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55661703-1f93-4f41-81e0-0d41f8b47f33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260]
Apr 12 07:44:07 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260] successful.
Apr 12 07:44:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08e0a1-3d7a-491b-a5ef-26139cc0844b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c876219-03bf-4a68-adc0-c3cc2a0b3871]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:07 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8123a84-b7b3-4852-beae-2df5effe5940]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:44:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJxMVQZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23266666666663265', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266666666663265', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lazy-loading 'pci_devices' on Instance uuid 32a42e95-630c-43a0-9217-2fc72f859f47 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:44:08 user nova-compute[82850]:   <uuid>32a42e95-630c-43a0-9217-2fc72f859f47</uuid>
Apr 12 07:44:08 user nova-compute[82850]:   <name>instance-00000010</name>
Apr 12 07:44:08 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:44:08 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:44:08 user nova-compute[82850]:   <metadata>
Apr 12 07:44:08 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:44:08 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:name>tempest-device-tagging-server-440809034</nova:name>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:44:03</nova:creationTime>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:44:08 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:44:08 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:owner>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:user uuid="e6ae1f3ccb2845fb9479448b50a0b919">tempest-TaggedBootDevicesTest-287287032-project-member</nova:user>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:project uuid="57b9766adb34464a8991764937c0f755">tempest-TaggedBootDevicesTest-287287032</nova:project>
Apr 12 07:44:08 user nova-compute[82850]:       </nova:owner>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:44:08 user nova-compute[82850]:       <nova:ports>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="9e1d8af4-ee87-40f8-b586-d000e0fa6653">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="7d15bdba-2895-4995-93c4-a687e1b18ae7">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="b07e4269-65c3-4fc9-9eaf-bb063b07f3ff">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="3c6de623-6a72-4ab8-a405-d9ffabab1f21">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.1.1.46" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="b7143159-bbbd-45e7-a085-faf5e834569d">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:         <nova:port uuid="54ea6af7-6239-4259-82dc-87e23894017a">
Apr 12 07:44:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 07:44:08 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:08 user nova-compute[82850]:       </nova:ports>
Apr 12 07:44:08 user nova-compute[82850]:     </nova:instance>
Apr 12 07:44:08 user nova-compute[82850]:   </metadata>
Apr 12 07:44:08 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:44:08 user nova-compute[82850]:     <system>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="serial">32a42e95-630c-43a0-9217-2fc72f859f47</entry>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="uuid">32a42e95-630c-43a0-9217-2fc72f859f47</entry>
Apr 12 07:44:08 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:44:08 user nova-compute[82850]:     </system>
Apr 12 07:44:08 user nova-compute[82850]:   </sysinfo>
Apr 12 07:44:08 user nova-compute[82850]:   <os>
Apr 12 07:44:08 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:44:08 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:44:08 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:44:08 user nova-compute[82850]:   </os>
Apr 12 07:44:08 user nova-compute[82850]:   <features>
Apr 12 07:44:08 user nova-compute[82850]:     <acpi/>
Apr 12 07:44:08 user nova-compute[82850]:     <apic/>
Apr 12 07:44:08 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:44:08 user nova-compute[82850]:   </features>
Apr 12 07:44:08 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:44:08 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:44:08 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:44:08 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:44:08 user nova-compute[82850]:   </clock>
Apr 12 07:44:08 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:44:08 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:44:08 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:44:08 user nova-compute[82850]:   </cpu>
Apr 12 07:44:08 user nova-compute[82850]:   <devices>
Apr 12 07:44:08 user nova-compute[82850]:     <disk type="file" device="cdrom">
Apr 12 07:44:08 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 07:44:08 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/disk.config"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="hda" bus="ide"/>
Apr 12 07:44:08 user nova-compute[82850]:     </disk>
Apr 12 07:44:08 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:44:08 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:44:08 user nova-compute[82850]:       <source dev="/dev/sde"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <serial>a2053ea8-adbe-41b6-9586-66df339c74fe</serial>
Apr 12 07:44:08 user nova-compute[82850]:     </disk>
Apr 12 07:44:08 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:44:08 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:44:08 user nova-compute[82850]:       <source dev="/dev/sdf"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <serial>713f4c6b-831b-4ecd-b993-2071b2c76652</serial>
Apr 12 07:44:08 user nova-compute[82850]:     </disk>
Apr 12 07:44:08 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:44:08 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:44:08 user nova-compute[82850]:       <source dev="/dev/sdg"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="vdc" bus="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <serial>739007bc-1202-495e-a5a1-67750ec8ad7e</serial>
Apr 12 07:44:08 user nova-compute[82850]:     </disk>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:e6:fb:f0"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tap9e1d8af4-ee"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:f9:74:63"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tap7d15bdba-28"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:5f:96:f5"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tapb07e4269-65"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:73:11:d4"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tapee6ca0d0-78"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:b7:ae:95"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tap3c6de623-6a"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:9f:cb:1a"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tapb7143159-bb"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:08 user nova-compute[82850]:       <mac address="fa:16:3e:86:de:98"/>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:08 user nova-compute[82850]:       <target dev="tap54ea6af7-62"/>
Apr 12 07:44:08 user nova-compute[82850]:     </interface>
Apr 12 07:44:08 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:44:08 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/console.log" append="off"/>
Apr 12 07:44:08 user nova-compute[82850]:     </serial>
Apr 12 07:44:08 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:44:08 user nova-compute[82850]:     <video>
Apr 12 07:44:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:08 user nova-compute[82850]:     </video>
Apr 12 07:44:08 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:44:08 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:44:08 user nova-compute[82850]:     </rng>
Apr 12 07:44:08 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:44:08 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:44:08 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:44:08 user nova-compute[82850]:     </memballoon>
Apr 12 07:44:08 user nova-compute[82850]:   </devices>
Apr 12 07:44:08 user nova-compute[82850]: </domain>
Apr 12 07:44:08 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: INFO nova.compute.manager [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Rescuing
Apr 12 07:44:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.neutron [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e1d8af4-ee, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e1d8af4-ee, col_values=(('external_ids', {'iface-id': '9e1d8af4-ee87-40f8-b586-d000e0fa6653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:fb:f0', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d15bdba-28, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d15bdba-28, col_values=(('external_ids', {'iface-id': '7d15bdba-2895-4995-93c4-a687e1b18ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:74:63', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb07e4269-65, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb07e4269-65, col_values=(('external_ids', {'iface-id': 'b07e4269-65c3-4fc9-9eaf-bb063b07f3ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:96:f5', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee6ca0d0-78, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee6ca0d0-78, col_values=(('external_ids', {'iface-id': 'ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:11:d4', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c6de623-6a, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c6de623-6a, col_values=(('external_ids', {'iface-id': '3c6de623-6a72-4ab8-a405-d9ffabab1f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ae:95', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7143159-bb, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7143159-bb, col_values=(('external_ids', {'iface-id': 'b7143159-bbbd-45e7-a085-faf5e834569d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:cb:1a', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ea6af7-62, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54ea6af7-62, col_values=(('external_ids', {'iface-id': '54ea6af7-6239-4259-82dc-87e23894017a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:de:98', 'vm-uuid': '32a42e95-630c-43a0-9217-2fc72f859f47'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:08 user nova-compute[82850]: INFO os_vif [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62')
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] No BDM found with device name hda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] No VIF found with MAC fa:16:3e:e6:fb:f0, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:44:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] No VIF found with MAC fa:16:3e:b7:ae:95, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:44:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Using config drive
Apr 12 07:44:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Creating config drive at /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/disk.config
Apr 12 07:44:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdlk2zu8n {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdlk2zu8n" returned: 0 in 0.052s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:09 user nova-compute[82850]: DEBUG nova.network.neutron [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:10 user nova-compute[82850]: WARNING nova.compute.manager [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state active and task_state rescuing.
Apr 12 07:44:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance destroyed successfully.
Apr 12 07:44:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Attempting rescue
Apr 12 07:44:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:44:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Creating image(s)
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue" returned: 0 in 0.073s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start _get_guest_xml network_info=[{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:79:b2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'numa_topology' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:11 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:11 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-226648607',display_name='tempest-ServerRescueNegativeTestJSON-server-226648607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-226648607',id=3,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-mxh96aw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:39:39Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:79:b2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:79:b2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:44:11 user nova-compute[82850]:   <uuid>e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</uuid>
Apr 12 07:44:11 user nova-compute[82850]:   <name>instance-00000003</name>
Apr 12 07:44:11 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:44:11 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:44:11 user nova-compute[82850]:   <metadata>
Apr 12 07:44:11 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:44:11 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-226648607</nova:name>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:44:11</nova:creationTime>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:44:11 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:44:11 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:owner>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:44:11 user nova-compute[82850]:       </nova:owner>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:44:11 user nova-compute[82850]:       <nova:ports>
Apr 12 07:44:11 user nova-compute[82850]:         <nova:port uuid="833dbd18-9190-4c45-8724-b57e1f46efcb">
Apr 12 07:44:11 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 07:44:11 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:11 user nova-compute[82850]:       </nova:ports>
Apr 12 07:44:11 user nova-compute[82850]:     </nova:instance>
Apr 12 07:44:11 user nova-compute[82850]:   </metadata>
Apr 12 07:44:11 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:44:11 user nova-compute[82850]:     <system>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="serial">e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</entry>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="uuid">e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2</entry>
Apr 12 07:44:11 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:44:11 user nova-compute[82850]:     </system>
Apr 12 07:44:11 user nova-compute[82850]:   </sysinfo>
Apr 12 07:44:11 user nova-compute[82850]:   <os>
Apr 12 07:44:11 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:44:11 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:44:11 user nova-compute[82850]:   </os>
Apr 12 07:44:11 user nova-compute[82850]:   <features>
Apr 12 07:44:11 user nova-compute[82850]:     <acpi/>
Apr 12 07:44:11 user nova-compute[82850]:     <apic/>
Apr 12 07:44:11 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:44:11 user nova-compute[82850]:   </features>
Apr 12 07:44:11 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:44:11 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:44:11 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:44:11 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:44:11 user nova-compute[82850]:   </clock>
Apr 12 07:44:11 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:44:11 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:44:11 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:44:11 user nova-compute[82850]:   </cpu>
Apr 12 07:44:11 user nova-compute[82850]:   <devices>
Apr 12 07:44:11 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:44:11 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:44:11 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue"/>
Apr 12 07:44:11 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:44:11 user nova-compute[82850]:     </disk>
Apr 12 07:44:11 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:44:11 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:44:11 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk"/>
Apr 12 07:44:11 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:44:11 user nova-compute[82850]:     </disk>
Apr 12 07:44:11 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:11 user nova-compute[82850]:       <mac address="fa:16:3e:79:b2:43"/>
Apr 12 07:44:11 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:11 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:11 user nova-compute[82850]:       <target dev="tap833dbd18-91"/>
Apr 12 07:44:11 user nova-compute[82850]:     </interface>
Apr 12 07:44:11 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:44:11 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/console.log" append="off"/>
Apr 12 07:44:11 user nova-compute[82850]:     </serial>
Apr 12 07:44:11 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:44:11 user nova-compute[82850]:     <video>
Apr 12 07:44:11 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:11 user nova-compute[82850]:     </video>
Apr 12 07:44:11 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:44:11 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:44:11 user nova-compute[82850]:     </rng>
Apr 12 07:44:11 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:44:11 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:44:11 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:44:11 user nova-compute[82850]:     </memballoon>
Apr 12 07:44:11 user nova-compute[82850]:   </devices>
Apr 12 07:44:11 user nova-compute[82850]: </domain>
Apr 12 07:44:11 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance destroyed successfully.
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:79:b2:43, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:11 user nova-compute[82850]: WARNING nova.compute.manager [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance with vm_state building and task_state spawning.
Apr 12 07:44:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:12 user nova-compute[82850]: WARNING nova.compute.manager [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state active and task_state rescuing.
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:12 user nova-compute[82850]: WARNING nova.compute.manager [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance with vm_state building and task_state spawning.
Apr 12 07:44:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:13 user nova-compute[82850]: WARNING nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance with vm_state building and task_state spawning.
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:13 user nova-compute[82850]: WARNING nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance with vm_state building and task_state spawning.
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:13 user nova-compute[82850]: WARNING nova.compute.manager [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance with vm_state building and task_state spawning.
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:14 user nova-compute[82850]: WARNING nova.compute.manager [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state active and task_state rescuing.
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:14 user nova-compute[82850]: WARNING nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance with vm_state building and task_state spawning.
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:14 user nova-compute[82850]: WARNING nova.compute.manager [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance with vm_state building and task_state spawning.
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:14 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:44:14 user nova-compute[82850]: INFO nova.compute.claims [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Claim successful on node user
Apr 12 07:44:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:44:15 user nova-compute[82850]: INFO nova.virt.block_device [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Booting with volume 50d3d191-8644-4001-b806-929d0e869a72 at /dev/vda
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:15 user nova-compute[82850]: WARNING nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance with vm_state building and task_state spawning.
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:15 user nova-compute[82850]: WARNING nova.compute.manager [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance with vm_state building and task_state spawning.
Apr 12 07:44:15 user nova-compute[82850]: DEBUG nova.policy [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8529b10e-4810-40e1-b360-b95f2d4f1aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205635b-d87f-465b-bf13-ab30447d166d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad8903d-14d1-463d-9e1e-15ae7f17a065]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2650134a-6ba3-430f-b481-d88b95fb3bd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5c242-4b70-4df2-87c2-623a54e7b9b5]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updating existing volume attachment record: 2011e5b1-f856-4547-937d-2cbe8dada968 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state active and task_state rescuing.
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a for instance with vm_state building and task_state spawning.
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a for instance with vm_state building and task_state spawning.
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance with vm_state building and task_state spawning.
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d for instance with vm_state building and task_state spawning.
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:16 user nova-compute[82850]: WARNING nova.compute.manager [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d for instance with vm_state building and task_state spawning.
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285457.5108876, 32a42e95-630c-43a0-9217-2fc72f859f47 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] VM Resumed (Lifecycle Event)
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance spawned successfully.
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285457.5114186, 32a42e95-630c-43a0-9217-2fc72f859f47 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] VM Started (Lifecycle Event)
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Successfully created port: 93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285457.628122, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Resumed (Lifecycle Event)
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Took 14.67 seconds to spawn the instance on the hypervisor.
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285457.6306741, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Started (Lifecycle Event)
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:18 user nova-compute[82850]: INFO nova.compute.manager [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Took 32.63 seconds to build instance.
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.744s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Successfully updated port: 93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-changed-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Refreshing instance network info cache due to event network-changed-93af7856-3e09-423a-a240-2e00ddcf6ce0. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Acquiring lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updating instance_info_cache with network_info: [{"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Instance network_info: |[{"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Acquired lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Refreshing network info cache for port 93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updated VIF entry in instance network info cache for port 93af7856-3e09-423a-a240-2e00ddcf6ce0. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updating instance_info_cache with network_info: [{"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Releasing lock "refresh_cache-487f2b38-0f8d-40c1-9c10-32caf60a61a2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:44:21 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Creating image(s)
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Ensure instance console log exists: /opt/stack/data/nova/instances/487f2b38-0f8d-40c1-9c10-32caf60a61a2/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Start _get_guest_xml network_info=[{"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyAkjEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '487f2b38-0f8d-40c1-9c10-32caf60a61a2', 'attached_at': '', 'detached_at': '', 'volume_id': '50d3d191-8644-4001-b806-929d0e869a72', 'serial': '50d3d191-8644-4001-b806-929d0e869a72'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '2011e5b1-f856-4547-937d-2cbe8dada968', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:44:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyAkjEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:44:21 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:21 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:44:21 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0066a90e-34ec-40d9-8ad5-a81d28af4f00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:44:21 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a20c84-ea3e-4fa2-aeda-8da18fe865fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72] added
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:22 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=26.287364959716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc2cc7-3f4f-44fd-a835-ce961a34148a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc7b510-4ef2-44ea-ac8a-464a1811ed65]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRyAkjEB {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRyAkjEB" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921cbfe-e569-43dc-8335-30ece59410af]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRyAkjEB'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b64c69-cbf6-4d20-b572-1ca056d3922c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7ec0c-289e-4acd-932f-274fca9a5d2b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 32a42e95-630c-43a0-9217-2fc72f859f47 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781b7b1-50fc-4649-828b-a546bddf8fd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260]
Apr 12 07:44:22 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260] successful.
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea5c4d8-619e-4714-ab8b-f14ec8693ab1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ad1734-84d7-4b2f-b726-295bb9e750de]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:44:22 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:44:22 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.993s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bffca-94df-406b-9f46-7015a04042f5]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:44:22 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyAkjEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.051s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (2053ms) {'type': 'block', 'scsi_wwn': '26133623761366561', 'path': '/dev/sdh'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133623761366561', 'path': '/dev/sdh'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1614827921',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-5b5oxx5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:44:16Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=487f2b38-0f8d-40c1-9c10-32caf60a61a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 487f2b38-0f8d-40c1-9c10-32caf60a61a2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:44:23 user nova-compute[82850]:   <uuid>487f2b38-0f8d-40c1-9c10-32caf60a61a2</uuid>
Apr 12 07:44:23 user nova-compute[82850]:   <name>instance-00000011</name>
Apr 12 07:44:23 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:44:23 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:44:23 user nova-compute[82850]:   <metadata>
Apr 12 07:44:23 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:44:23 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:44:23 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1614827921</nova:name>
Apr 12 07:44:23 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:44:21</nova:creationTime>
Apr 12 07:44:23 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:44:23 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:44:23 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:44:23 user nova-compute[82850]:       <nova:owner>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:44:23 user nova-compute[82850]:       </nova:owner>
Apr 12 07:44:23 user nova-compute[82850]:       <nova:ports>
Apr 12 07:44:23 user nova-compute[82850]:         <nova:port uuid="93af7856-3e09-423a-a240-2e00ddcf6ce0">
Apr 12 07:44:23 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:44:23 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:23 user nova-compute[82850]:       </nova:ports>
Apr 12 07:44:23 user nova-compute[82850]:     </nova:instance>
Apr 12 07:44:23 user nova-compute[82850]:   </metadata>
Apr 12 07:44:23 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:44:23 user nova-compute[82850]:     <system>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="serial">487f2b38-0f8d-40c1-9c10-32caf60a61a2</entry>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="uuid">487f2b38-0f8d-40c1-9c10-32caf60a61a2</entry>
Apr 12 07:44:23 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:44:23 user nova-compute[82850]:     </system>
Apr 12 07:44:23 user nova-compute[82850]:   </sysinfo>
Apr 12 07:44:23 user nova-compute[82850]:   <os>
Apr 12 07:44:23 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:44:23 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:44:23 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:44:23 user nova-compute[82850]:   </os>
Apr 12 07:44:23 user nova-compute[82850]:   <features>
Apr 12 07:44:23 user nova-compute[82850]:     <acpi/>
Apr 12 07:44:23 user nova-compute[82850]:     <apic/>
Apr 12 07:44:23 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:44:23 user nova-compute[82850]:   </features>
Apr 12 07:44:23 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:44:23 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:44:23 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:44:23 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:44:23 user nova-compute[82850]:   </clock>
Apr 12 07:44:23 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:44:23 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:44:23 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:44:23 user nova-compute[82850]:   </cpu>
Apr 12 07:44:23 user nova-compute[82850]:   <devices>
Apr 12 07:44:23 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:44:23 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:44:23 user nova-compute[82850]:       <source dev="/dev/sdh"/>
Apr 12 07:44:23 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:44:23 user nova-compute[82850]:       <serial>50d3d191-8644-4001-b806-929d0e869a72</serial>
Apr 12 07:44:23 user nova-compute[82850]:     </disk>
Apr 12 07:44:23 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:23 user nova-compute[82850]:       <mac address="fa:16:3e:25:59:48"/>
Apr 12 07:44:23 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:23 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:23 user nova-compute[82850]:       <target dev="tap93af7856-3e"/>
Apr 12 07:44:23 user nova-compute[82850]:     </interface>
Apr 12 07:44:23 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:44:23 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/487f2b38-0f8d-40c1-9c10-32caf60a61a2/console.log" append="off"/>
Apr 12 07:44:23 user nova-compute[82850]:     </serial>
Apr 12 07:44:23 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:44:23 user nova-compute[82850]:     <video>
Apr 12 07:44:23 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:23 user nova-compute[82850]:     </video>
Apr 12 07:44:23 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:44:23 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:44:23 user nova-compute[82850]:     </rng>
Apr 12 07:44:23 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:44:23 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:44:23 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:44:23 user nova-compute[82850]:     </memballoon>
Apr 12 07:44:23 user nova-compute[82850]:   </devices>
Apr 12 07:44:23 user nova-compute[82850]: </domain>
Apr 12 07:44:23 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1614827921',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-5b5oxx5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:44:16Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=487f2b38-0f8d-40c1-9c10-32caf60a61a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG os_vif [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93af7856-3e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93af7856-3e, col_values=(('external_ids', {'iface-id': '93af7856-3e09-423a-a240-2e00ddcf6ce0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:59:48', 'vm-uuid': '487f2b38-0f8d-40c1-9c10-32caf60a61a2'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:24 user nova-compute[82850]: INFO os_vif [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e')
Apr 12 07:44:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:25:59:48, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] No waiting events found dispatching network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:26 user nova-compute[82850]: WARNING nova.compute.manager [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received unexpected event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance with vm_state building and task_state spawning.
Apr 12 07:44:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285468.4947488, 487f2b38-0f8d-40c1-9c10-32caf60a61a2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] VM Resumed (Lifecycle Event)
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Instance spawned successfully.
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285468.4963458, 487f2b38-0f8d-40c1-9c10-32caf60a61a2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] VM Started (Lifecycle Event)
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Took 6.84 seconds to spawn the instance on the hypervisor.
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] No waiting events found dispatching network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:28 user nova-compute[82850]: WARNING nova.compute.manager [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received unexpected event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance with vm_state building and task_state spawning.
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:28 user nova-compute[82850]: INFO nova.compute.manager [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Took 13.88 seconds to build instance.
Apr 12 07:44:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.991s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:36 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:44:36 user nova-compute[82850]: INFO nova.compute.claims [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Claim successful on node user
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:44:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.policy [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '775732b835f44e7baf889683808bb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbd1aa653244a39d6c81f2b9d669f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:44:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Creating image(s)
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "/opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "/opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "/opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.153s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk 1073741824" returned: 0 in 0.048s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:44:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Cannot resize image /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'migration_context' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Ensure instance console log exists: /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Successfully created port: 717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Successfully updated port: 717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquired lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing instance network info cache due to event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:44:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Acquiring lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating instance_info_cache with network_info: [{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Releasing lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Instance network_info: |[{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Acquired lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Start _get_guest_xml network_info=[{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:44:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352660305',display_name='tempest-SnapshotDataIntegrityTests-server-1352660305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352660305',id=18,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKY3IfLbQtlg9TTvQ4KUShSpDfiYSwffhY1f5sy0yXcOfZzR2YPa+yu4MsobcQPV5jgbrwG1tvBCtM7wUngdWCr1fKuPVs1PI6G5g3xFfWG8LfUY5f9YX3pJC+Y/2sgug==',key_name='tempest-SnapshotDataIntegrityTests-33494310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbbd1aa653244a39d6c81f2b9d669f5',ramdisk_id='',reservation_id='r-lvykmi55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-330964735',owner_user_name='tempest-SnapshotDataIntegrityTests-330964735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:44:37Z,user_data=None,user_id='775732b835f44e7baf889683808bb3dd',uuid=31672149-0612-4e15-aacd-e37c7536109c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converting VIF {"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'pci_devices' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:44:39 user nova-compute[82850]:   <uuid>31672149-0612-4e15-aacd-e37c7536109c</uuid>
Apr 12 07:44:39 user nova-compute[82850]:   <name>instance-00000012</name>
Apr 12 07:44:39 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:44:39 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:44:39 user nova-compute[82850]:   <metadata>
Apr 12 07:44:39 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:44:39 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1352660305</nova:name>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:44:39</nova:creationTime>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:44:39 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:44:39 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:owner>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:user uuid="775732b835f44e7baf889683808bb3dd">tempest-SnapshotDataIntegrityTests-330964735-project-member</nova:user>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:project uuid="7dbbd1aa653244a39d6c81f2b9d669f5">tempest-SnapshotDataIntegrityTests-330964735</nova:project>
Apr 12 07:44:39 user nova-compute[82850]:       </nova:owner>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:44:39 user nova-compute[82850]:       <nova:ports>
Apr 12 07:44:39 user nova-compute[82850]:         <nova:port uuid="717e6ad1-b01a-4647-8a55-6fe494a39c4a">
Apr 12 07:44:39 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 07:44:39 user nova-compute[82850]:         </nova:port>
Apr 12 07:44:39 user nova-compute[82850]:       </nova:ports>
Apr 12 07:44:39 user nova-compute[82850]:     </nova:instance>
Apr 12 07:44:39 user nova-compute[82850]:   </metadata>
Apr 12 07:44:39 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:44:39 user nova-compute[82850]:     <system>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="serial">31672149-0612-4e15-aacd-e37c7536109c</entry>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="uuid">31672149-0612-4e15-aacd-e37c7536109c</entry>
Apr 12 07:44:39 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:44:39 user nova-compute[82850]:     </system>
Apr 12 07:44:39 user nova-compute[82850]:   </sysinfo>
Apr 12 07:44:39 user nova-compute[82850]:   <os>
Apr 12 07:44:39 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:44:39 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:44:39 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:44:39 user nova-compute[82850]:   </os>
Apr 12 07:44:39 user nova-compute[82850]:   <features>
Apr 12 07:44:39 user nova-compute[82850]:     <acpi/>
Apr 12 07:44:39 user nova-compute[82850]:     <apic/>
Apr 12 07:44:39 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:44:39 user nova-compute[82850]:   </features>
Apr 12 07:44:39 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:44:39 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:44:39 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:44:39 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:44:39 user nova-compute[82850]:   </clock>
Apr 12 07:44:39 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:44:39 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:44:39 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:44:39 user nova-compute[82850]:   </cpu>
Apr 12 07:44:39 user nova-compute[82850]:   <devices>
Apr 12 07:44:39 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:44:39 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:44:39 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk"/>
Apr 12 07:44:39 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:44:39 user nova-compute[82850]:     </disk>
Apr 12 07:44:39 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:44:39 user nova-compute[82850]:       <mac address="fa:16:3e:04:2c:ea"/>
Apr 12 07:44:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:39 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:44:39 user nova-compute[82850]:       <target dev="tap717e6ad1-b0"/>
Apr 12 07:44:39 user nova-compute[82850]:     </interface>
Apr 12 07:44:39 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:44:39 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/console.log" append="off"/>
Apr 12 07:44:39 user nova-compute[82850]:     </serial>
Apr 12 07:44:39 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:44:39 user nova-compute[82850]:     <video>
Apr 12 07:44:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:44:39 user nova-compute[82850]:     </video>
Apr 12 07:44:39 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:44:39 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:44:39 user nova-compute[82850]:     </rng>
Apr 12 07:44:39 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:44:39 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:44:39 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:44:39 user nova-compute[82850]:     </memballoon>
Apr 12 07:44:39 user nova-compute[82850]:   </devices>
Apr 12 07:44:39 user nova-compute[82850]: </domain>
Apr 12 07:44:39 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352660305',display_name='tempest-SnapshotDataIntegrityTests-server-1352660305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352660305',id=18,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKY3IfLbQtlg9TTvQ4KUShSpDfiYSwffhY1f5sy0yXcOfZzR2YPa+yu4MsobcQPV5jgbrwG1tvBCtM7wUngdWCr1fKuPVs1PI6G5g3xFfWG8LfUY5f9YX3pJC+Y/2sgug==',key_name='tempest-SnapshotDataIntegrityTests-33494310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbbd1aa653244a39d6c81f2b9d669f5',ramdisk_id='',reservation_id='r-lvykmi55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-330964735',owner_user_name='tempest-SnapshotDataIntegrityTests-330964735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:44:37Z,user_data=None,user_id='775732b835f44e7baf889683808bb3dd',uuid=31672149-0612-4e15-aacd-e37c7536109c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converting VIF {"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG os_vif [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717e6ad1-b0, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap717e6ad1-b0, col_values=(('external_ids', {'iface-id': '717e6ad1-b01a-4647-8a55-6fe494a39c4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2c:ea', 'vm-uuid': '31672149-0612-4e15-aacd-e37c7536109c'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:39 user nova-compute[82850]: INFO os_vif [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0')
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No VIF found with MAC fa:16:3e:04:2c:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updated VIF entry in instance network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating instance_info_cache with network_info: [{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Releasing lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:44:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] No waiting events found dispatching network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:41 user nova-compute[82850]: WARNING nova.compute.manager [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received unexpected event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance with vm_state building and task_state spawning.
Apr 12 07:44:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285483.1827438, 31672149-0612-4e15-aacd-e37c7536109c => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] VM Resumed (Lifecycle Event)
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Instance spawned successfully.
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285483.184223, 31672149-0612-4e15-aacd-e37c7536109c => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] VM Started (Lifecycle Event)
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] No waiting events found dispatching network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:43 user nova-compute[82850]: WARNING nova.compute.manager [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received unexpected event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance with vm_state building and task_state spawning.
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Took 5.95 seconds to spawn the instance on the hypervisor.
Apr 12 07:44:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:44:43 user nova-compute[82850]: INFO nova.compute.manager [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Took 6.82 seconds to build instance.
Apr 12 07:44:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:49 user nova-compute[82850]: INFO nova.compute.manager [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Terminating instance
Apr 12 07:44:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-unplugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] No waiting events found dispatching network-vif-unplugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-unplugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:44:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Instance destroyed successfully.
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.objects.instance [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'resources' on Instance uuid 4820ef5a-bb6b-4b54-987b-071d51bca7d7 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788052455',display_name='tempest-VolumesAdminNegativeTest-server-1788052455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788052455',id=15,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-fpcuwz15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:43:00Z,user_data=None,user_id='8de4929e67ed472b90e95066b2c50340',uuid=4820ef5a-bb6b-4b54-987b-071d51bca7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "address": "fa:16:3e:8f:ea:ea", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3047f54e-67", "ovs_interfaceid": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG os_vif [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3047f54e-67, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:44:50 user nova-compute[82850]: INFO os_vif [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:ea,bridge_name='br-int',has_traffic_filtering=True,id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3047f54e-67')
Apr 12 07:44:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Deleting instance files /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7_del
Apr 12 07:44:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Deletion of /opt/stack/data/nova/instances/4820ef5a-bb6b-4b54-987b-071d51bca7d7_del complete
Apr 12 07:44:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:50 user nova-compute[82850]: INFO nova.compute.manager [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 12 07:44:50 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:44:50 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:44:51 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:51 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Took 0.76 seconds to deallocate network for instance.
Apr 12 07:44:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-deleted-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:51 user nova-compute[82850]: INFO nova.compute.manager [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Neutron deleted interface 3047f54e-67d3-4ca8-8e19-a5d01ba1db57; detaching it from the instance and deleting it from the info cache
Apr 12 07:44:51 user nova-compute[82850]: DEBUG nova.network.neutron [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:44:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Detach interface failed, port_id=3047f54e-67d3-4ca8-8e19-a5d01ba1db57, reason: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:44:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Acquiring lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] No waiting events found dispatching network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:44:52 user nova-compute[82850]: WARNING nova.compute.manager [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Received unexpected event network-vif-plugged-3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance with vm_state deleted and task_state None.
Apr 12 07:44:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.712s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:52 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Deleted allocations for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7
Apr 12 07:44:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "4820ef5a-bb6b-4b54-987b-071d51bca7d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:44:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:44:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:05 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285490.1787782, 4820ef5a-bb6b-4b54-987b-071d51bca7d7 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:05 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] VM Stopped (Lifecycle Event)
Apr 12 07:45:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de759302-b38d-4f7f-8f50-7025e254dac9 None None] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 07:45:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:12 user nova-compute[82850]: INFO nova.compute.manager [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Detaching volume d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:45:12 user nova-compute[82850]: INFO nova.virt.block_device [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Attempting to driver detach volume d264d7ac-e4d5-48b7-b5f8-11b463caef9f from mountpoint /dev/vdb
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Attempting to detach device vdb from instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:45:12 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:45:12 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:45:12 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:45:12 user nova-compute[82850]:   <serial>d264d7ac-e4d5-48b7-b5f8-11b463caef9f</serial>
Apr 12 07:45:12 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:45:12 user nova-compute[82850]: </disk>
Apr 12 07:45:12 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:45:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdb from instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 from the persistent domain config.
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:45:12 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:45:12 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:45:12 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:45:12 user nova-compute[82850]:   <serial>d264d7ac-e4d5-48b7-b5f8-11b463caef9f</serial>
Apr 12 07:45:12 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:45:12 user nova-compute[82850]: </disk>
Apr 12 07:45:12 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285512.6654377, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:45:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdb from instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 from the live domain config.
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrqzIwHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:45:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd97974-d92d-4763-846d-d9ef584bdc6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:45:12 user nova-compute[82850]: No targets found.
Apr 12 07:45:12 user nova-compute[82850]: iSNS:
Apr 12 07:45:12 user nova-compute[82850]: No targets found.
Apr 12 07:45:12 user nova-compute[82850]: STATIC:
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:12 user nova-compute[82850]: FIRMWARE:
Apr 12 07:45:12 user nova-compute[82850]: No targets found.
Apr 12 07:45:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:45:12 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:45:12 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[879c517e-0298-478b-84d6-1888969b35bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[729dee7b-670d-4b1d-bc2b-c2d6f6bd4374]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:12 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c2aaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b54c4-3189-4524-a259-56b7cf0753ed]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[112c856a-7ff8-4f5a-8b41-d9b8cd7ec3f4]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca55afae-94d4-4c13-ad80-9e5903613541]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c37d2-af51-4eca-a3d3-ca50141208c0]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa957d46-bc27-4de6-add4-72bfa15c3d7a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c124a06a-f792-4541-8eb4-b48da25727d2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260]
Apr 12 07:45:12 user nova-compute[82850]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:45:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d264d7ac-e4d5-48b7-b5f8-11b463caef9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e451bf-e9c3-47a6-b4eb-b161cda47fe2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== disconnect_volume: return (337ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82850) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:14 user nova-compute[82850]: WARNING nova.compute.manager [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state active and task_state powering-off.
Apr 12 07:45:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance destroyed successfully.
Apr 12 07:45:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:15 user nova-compute[82850]: INFO nova.compute.manager [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Unrescuing
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:45:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'flavor' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:16 user nova-compute[82850]: WARNING nova.compute.manager [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:16 user nova-compute[82850]: WARNING nova.compute.manager [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state None.
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance destroyed successfully.
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:18 user nova-compute[82850]: WARNING nova.compute.manager [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:45:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing instance network info cache due to event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updated VIF entry in instance network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing instance network info cache due to event network-changed-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:19 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Refreshing network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:21 user nova-compute[82850]: WARNING nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:21 user nova-compute[82850]: WARNING nova.compute.manager [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 69aeabdc-65e3-4af2-9f8b-3699778c6b89 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285520.8530633, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:21 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Resumed (Lifecycle Event)
Apr 12 07:45:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:45:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7415MB free_disk=26.24422836303711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:45:21 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285520.8539236, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:21 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Started (Lifecycle Event)
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance d4f9729d-3114-4fc6-a704-02f436c17614 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 32a42e95-630c-43a0-9217-2fc72f859f47 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updated VIF entry in instance network info cache for port 0b334cc7-e101-4fdc-9a60-98cf9c11d7ca. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 07:45:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 07:45:22 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:45:22 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:45:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:45:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:45:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:30 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285515.2049499, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:30 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Stopped (Lifecycle Event)
Apr 12 07:45:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-34466855-0f71-4594-989a-2d22dc54a2b3 None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-34466855-0f71-4594-989a-2d22dc54a2b3 None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:45:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-changed-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing instance network info cache due to event network-changed-9e1d8af4-ee87-40f8-b586-d000e0fa6653. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Acquiring lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Acquired lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:35 user nova-compute[82850]: DEBUG nova.network.neutron [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Refreshing network info cache for port 9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:45:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updated VIF entry in instance network info cache for port 9e1d8af4-ee87-40f8-b586-d000e0fa6653. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:45:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Releasing lock "refresh_cache-32a42e95-630c-43a0-9217-2fc72f859f47" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:37 user nova-compute[82850]: INFO nova.compute.manager [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Terminating instance
Apr 12 07:45:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-54ea6af7-6239-4259-82dc-87e23894017a for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Instance destroyed successfully.
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.objects.instance [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lazy-loading 'resources' on Instance uuid 32a42e95-630c-43a0-9217-2fc72f859f47 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e1d8af4-ee, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fb:f0,bridge_name='br-int',has_traffic_filtering=True,id=9e1d8af4-ee87-40f8-b586-d000e0fa6653,network=Network(d8752b4e-67f0-47ea-8534-b709ccb1dbfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1d8af4-ee')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d15bdba-28, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:74:63,bridge_name='br-int',has_traffic_filtering=True,id=7d15bdba-2895-4995-93c4-a687e1b18ae7,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d15bdba-28')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb07e4269-65, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:96:f5,bridge_name='br-int',has_traffic_filtering=True,id=b07e4269-65c3-4fc9-9eaf-bb063b07f3ff,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb07e4269-65')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee6ca0d0-78, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:d4,bridge_name='br-int',has_traffic_filtering=True,id=ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6ca0d0-78')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c6de623-6a, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=3c6de623-6a72-4ab8-a405-d9ffabab1f21,network=Network(d095779d-7e48-4417-bcc7-2da4d70b267b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6de623-6a')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "b7143159-bbbd-45e7-a085-faf5e834569d", "address": "fa:16:3e:9f:cb:1a", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7143159-bb", "ovs_interfaceid": "b7143159-bbbd-45e7-a085-faf5e834569d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7143159-bb, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:cb:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7143159-bbbd-45e7-a085-faf5e834569d,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7143159-bb')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T07:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-440809034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-440809034',id=16,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA==',key_name='tempest-keypair-765614204',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9766adb34464a8991764937c0f755',ramdisk_id='',reservation_id='r-59je04iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-287287032',owner_user_name='tempest-TaggedBootDevicesTest-287287032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ae1f3ccb2845fb9479448b50a0b919',uuid=32a42e95-630c-43a0-9217-2fc72f859f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converting VIF {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ea6af7-62, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:39 user nova-compute[82850]: INFO os_vif [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:de:98,bridge_name='br-int',has_traffic_filtering=True,id=54ea6af7-6239-4259-82dc-87e23894017a,network=Network(f521d7e5-4303-4398-b38a-6827dedbe33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ea6af7-62')
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfUtWRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:45:39 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e239b06-ff3e-4e26-a890-0466fcbec018]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:45:39 user nova-compute[82850]: No targets found.
Apr 12 07:45:39 user nova-compute[82850]: iSNS:
Apr 12 07:45:39 user nova-compute[82850]: No targets found.
Apr 12 07:45:39 user nova-compute[82850]: STATIC:
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:39 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:39 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:39 user nova-compute[82850]: FIRMWARE:
Apr 12 07:45:39 user nova-compute[82850]: No targets found.
Apr 12 07:45:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:45:39 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:45:39 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7948c6-d952-4288-ba60-a697a030d0b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ea482-4363-473d-84b4-fdea306dbb8d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:39 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194ecabd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe'): ({'sde'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Removing single pathed devices sde {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35985451-e258-45f0-9f09-85a27a14d981]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ec461-8555-48eb-befc-773499c3a277]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flushing IO for device /dev/sde {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7304b-3318-4855-91c6-11c9de94d8db]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85b450-bbea-470d-9c62-0f61d8e629d6]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd8134-e6af-4b63-a0f0-cb99e62ad72c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c4ea00-6d1d-4e9f-8c74-c7fce987a389]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260]
Apr 12 07:45:39 user nova-compute[82850]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe, portal: 172.16.0.220,3260] successful.
Apr 12 07:45:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2053ea8-adbe-41b6-9586-66df339c74fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e55b12-8753-45ca-8db6-618f67dea00e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== disconnect_volume: return (324ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdGsUHSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:45:39 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:45:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4bb98a-eaff-482a-b6ed-988b9eb0a7d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]: iSNS:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]: STATIC:
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: FIRMWARE:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:45:40 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:45:40 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93454830-794c-43bb-b89c-dd0297f04c97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a13581a-a4fb-4081-8af2-01646bc59573]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c3144c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652'): ({'sdf'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Removing single pathed devices sdf {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-b7143159-bbbd-45e7-a085-faf5e834569d for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b7143159-bbbd-45e7-a085-faf5e834569d for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9250acd-825f-4b53-9a26-5506655f6635]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0becf389-97b3-4a9f-9252-123671d41892]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flushing IO for device /dev/sdf {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35746d64-0655-49bf-a262-25d049b1d3cd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d173a2-09ea-4da2-b656-3b470f21d40e]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf6fb7-4d74-4e70-883d-2424b0e24985]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-unplugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-unplugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[241073b8-e188-45d5-82b2-5f9650ba5111]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260]
Apr 12 07:45:40 user nova-compute[82850]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652, portal: 172.16.0.220,3260] successful.
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713f4c6b-831b-4ecd-b993-2071b2c76652 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e56317-470d-488c-9447-eed5c58cbf24]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== disconnect_volume: return (312ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJxMVQZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cd31f6-1e0b-4fbb-899a-ae830dc9d267]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]: iSNS:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]: STATIC:
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:40 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:40 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:40 user nova-compute[82850]: FIRMWARE:
Apr 12 07:45:40 user nova-compute[82850]: No targets found.
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:45:40 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:45:40 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a26d6-1841-4f07-8817-96873a4c91f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb6d92-dc25-4781-85d6-59c3708b3d68]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e (non-flash)
Apr 12 07:45:40 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0af880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705f7d0-5226-4e52-9788-5f6024900cca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be228d3-fa3c-4c29-99a2-74140150470a]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c112a-6f71-462c-9e08-ca175da56302]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79edd3f6-7109-4a65-a577-115ffe3642ec]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38960689-5993-4e35-b052-71a8e7f7455d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8c7c2-98bc-4306-b4f0-1dd01f35b8e2]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260]
Apr 12 07:45:40 user nova-compute[82850]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e, portal: 172.16.0.220,3260] successful.
Apr 12 07:45:40 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739007bc-1202-495e-a5a1-67750ec8ad7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee9b23-0d6a-458c-bcf5-55636e4ad56f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] <== disconnect_volume: return (313ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:45:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Deleting instance files /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47_del
Apr 12 07:45:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Deletion of /opt/stack/data/nova/instances/32a42e95-630c-43a0-9217-2fc72f859f47_del complete
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Lock "32a42e95-630c-43a0-9217-2fc72f859f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] No waiting events found dispatching network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:40 user nova-compute[82850]: WARNING nova.compute.manager [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received unexpected event network-vif-plugged-54ea6af7-6239-4259-82dc-87e23894017a for instance with vm_state active and task_state deleting.
Apr 12 07:45:40 user nova-compute[82850]: INFO nova.compute.manager [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Took 3.33 seconds to destroy the instance on the hypervisor.
Apr 12 07:45:40 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:45:40 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:45:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:41 user nova-compute[82850]: INFO nova.compute.manager [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Terminating instance
Apr 12 07:45:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-unplugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] No waiting events found dispatching network-vif-unplugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-unplugged-f5da504b-425d-45d4-a150-7399af15f563 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:45:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Instance destroyed successfully.
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'resources' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359303190',display_name='tempest-VolumesAdminNegativeTest-server-1359303190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359303190',id=9,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrg4uHMBkAMw3UoqXTbvqnDFv+1eFvHSIxqnyVVNp9NtV1YTHEmXxQnYA72VxlIYNV/oW5eS6gzorv3tPjOcZ97EcXqfkecc1MgFQlMPDaeUsR9Ha/s9A4emn7MslwQtw==',key_name='tempest-keypair-827036857',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a93f4d88764fd49cd8b2eb9ff1cb8f',ramdisk_id='',reservation_id='r-1hg95u4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-407566417',owner_user_name='tempest-VolumesAdminNegativeTest-407566417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de4929e67ed472b90e95066b2c50340',uuid=d4f9729d-3114-4fc6-a704-02f436c17614,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converting VIF {"id": "f5da504b-425d-45d4-a150-7399af15f563", "address": "fa:16:3e:88:83:08", "network": {"id": "794c3330-22fe-49a1-a6ed-46aac1833b26", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1979908722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a93f4d88764fd49cd8b2eb9ff1cb8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5da504b-42", "ovs_interfaceid": "f5da504b-425d-45d4-a150-7399af15f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG os_vif [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5da504b-42, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:42 user nova-compute[82850]: INFO os_vif [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:83:08,bridge_name='br-int',has_traffic_filtering=True,id=f5da504b-425d-45d4-a150-7399af15f563,network=Network(794c3330-22fe-49a1-a6ed-46aac1833b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5da504b-42')
Apr 12 07:45:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Deleting instance files /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614_del
Apr 12 07:45:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Deletion of /opt/stack/data/nova/instances/d4f9729d-3114-4fc6-a704-02f436c17614_del complete
Apr 12 07:45:42 user nova-compute[82850]: INFO nova.compute.manager [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 07:45:42 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-deleted-b7143159-bbbd-45e7-a085-faf5e834569d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:42 user nova-compute[82850]: INFO nova.compute.manager [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Neutron deleted interface b7143159-bbbd-45e7-a085-faf5e834569d; detaching it from the instance and deleting it from the info cache
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54ea6af7-6239-4259-82dc-87e23894017a", "address": "fa:16:3e:86:de:98", "network": {"id": "f521d7e5-4303-4398-b38a-6827dedbe33a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642602693", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ea6af7-62", "ovs_interfaceid": "54ea6af7-6239-4259-82dc-87e23894017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Detach interface failed, port_id=b7143159-bbbd-45e7-a085-faf5e834569d, reason: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:45:43 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:43 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Took 1.15 seconds to deallocate network for instance.
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:44 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Deleted allocations for instance d4f9729d-3114-4fc6-a704-02f436c17614
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "d4f9729d-3114-4fc6-a704-02f436c17614" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.541s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Acquiring lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Lock "d4f9729d-3114-4fc6-a704-02f436c17614-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] No waiting events found dispatching network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:45:44 user nova-compute[82850]: WARNING nova.compute.manager [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received unexpected event network-vif-plugged-f5da504b-425d-45d4-a150-7399af15f563 for instance with vm_state deleted and task_state None.
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-deleted-54ea6af7-6239-4259-82dc-87e23894017a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:44 user nova-compute[82850]: INFO nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Neutron deleted interface 54ea6af7-6239-4259-82dc-87e23894017a; detaching it from the instance and deleting it from the info cache
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "address": "fa:16:3e:e6:fb:f0", "network": {"id": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1550845794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1d8af4-ee", "ovs_interfaceid": "9e1d8af4-ee87-40f8-b586-d000e0fa6653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Detach interface failed, port_id=54ea6af7-6239-4259-82dc-87e23894017a, reason: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Received event network-vif-deleted-f5da504b-425d-45d4-a150-7399af15f563 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-deleted-9e1d8af4-ee87-40f8-b586-d000e0fa6653 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:44 user nova-compute[82850]: INFO nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Neutron deleted interface 9e1d8af4-ee87-40f8-b586-d000e0fa6653; detaching it from the instance and deleting it from the info cache
Apr 12 07:45:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "address": "fa:16:3e:b7:ae:95", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6de623-6a", "ovs_interfaceid": "3c6de623-6a72-4ab8-a405-d9ffabab1f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Detach interface failed, port_id=9e1d8af4-ee87-40f8-b586-d000e0fa6653, reason: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-deleted-3c6de623-6a72-4ab8-a405-d9ffabab1f21 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:45 user nova-compute[82850]: INFO nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Neutron deleted interface 3c6de623-6a72-4ab8-a405-d9ffabab1f21; detaching it from the instance and deleting it from the info cache
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.network.neutron [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [{"id": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "address": "fa:16:3e:f9:74:63", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d15bdba-28", "ovs_interfaceid": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "address": "fa:16:3e:5f:96:f5", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e4269-65", "ovs_interfaceid": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "address": "fa:16:3e:73:11:d4", "network": {"id": "d095779d-7e48-4417-bcc7-2da4d70b267b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1292846581", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9766adb34464a8991764937c0f755", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6ca0d0-78", "ovs_interfaceid": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Detach interface failed, port_id=3c6de623-6a72-4ab8-a405-d9ffabab1f21, reason: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:45 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Took 4.45 seconds to deallocate network for instance.
Apr 12 07:45:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:45:45 user nova-compute[82850]: WARNING nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid e21b1323-aafd-4989-92c0-3ba5b45ba2bc {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 32a42e95-630c-43a0-9217-2fc72f859f47 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 487f2b38-0f8d-40c1-9c10-32caf60a61a2 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "acbd6126-210b-41cf-a994-528233e5369b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "32a42e95-630c-43a0-9217-2fc72f859f47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "acbd6126-210b-41cf-a994-528233e5369b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Received event network-vif-deleted-ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:45:47 user nova-compute[82850]: INFO nova.compute.manager [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Took 2.29 seconds to detach 3 volumes for instance.
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:47 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Deleted allocations for instance 32a42e95-630c-43a0-9217-2fc72f859f47
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.523s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.229s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:47 user nova-compute[82850]: INFO nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 12 07:45:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "32a42e95-630c-43a0-9217-2fc72f859f47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:45:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:45:48 user nova-compute[82850]: INFO nova.compute.manager [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Detaching volume 50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:48 user nova-compute[82850]: INFO nova.virt.block_device [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Attempting to driver detach volume 50ebd7de-6dee-4a5b-ba64-d910fb73e897 from mountpoint /dev/vdb
Apr 12 07:45:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Attempting to detach device vdb from instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:45:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:45:48 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:45:48 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:45:48 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:45:48 user nova-compute[82850]:   <serial>50ebd7de-6dee-4a5b-ba64-d910fb73e897</serial>
Apr 12 07:45:48 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:45:48 user nova-compute[82850]: </disk>
Apr 12 07:45:48 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:45:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Successfully detached device vdb from instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 from the persistent domain config.
Apr 12 07:45:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:45:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:45:48 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:45:48 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:45:48 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:45:48 user nova-compute[82850]:   <serial>50ebd7de-6dee-4a5b-ba64-d910fb73e897</serial>
Apr 12 07:45:48 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:45:48 user nova-compute[82850]: </disk>
Apr 12 07:45:48 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285549.1248317, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:45:49 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Successfully detached device vdb from instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 from the live domain config.
Apr 12 07:45:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWkCJuQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:45:49 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac304d54-8ca8-4375-baad-c22cb027eb11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:45:49 user nova-compute[82850]: No targets found.
Apr 12 07:45:49 user nova-compute[82850]: iSNS:
Apr 12 07:45:49 user nova-compute[82850]: No targets found.
Apr 12 07:45:49 user nova-compute[82850]: STATIC:
Apr 12 07:45:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:45:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:45:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897
Apr 12 07:45:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:45:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:45:49 user nova-compute[82850]: FIRMWARE:
Apr 12 07:45:49 user nova-compute[82850]: No targets found.
Apr 12 07:45:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:45:49 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:45:49 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01567cee-604b-4874-809d-956507a06d3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab775254-8384-46c3-8ddb-32cf781b04c0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:49 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:49 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 (non-flash)
Apr 12 07:45:49 user nova-compute[82850]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:45:49 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:45:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c5877f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[554dcb84-bf1f-45f5-89eb-a9f555e3368b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e8c5c-b80c-4fc9-a458-19be6807b5d1]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b110a6d-0448-4707-84c2-9cc7dc0d1458]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaaebd7-3653-4dc7-bf39-456d177e6096]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c23f937-d57d-4e32-ba91-1204938ac39c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7188a0f-8136-4fba-9cbb-ae2889530cf7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260]
Apr 12 07:45:49 user nova-compute[82850]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897, portal: 172.16.0.220,3260] successful.
Apr 12 07:45:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50ebd7de-6dee-4a5b-ba64-d910fb73e897 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f999f0db-5f19-44e2-9a15-6e04fa89b706]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] <== disconnect_volume: return (281ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:45:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:45:50 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'flavor' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:45:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:45:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:54 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285539.2974637, 32a42e95-630c-43a0-9217-2fc72f859f47 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:54 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] VM Stopped (Lifecycle Event)
Apr 12 07:45:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4905cf4e-4e1d-4294-af38-fddf6a5f476b None None] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:57 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285542.7262087, d4f9729d-3114-4fc6-a704-02f436c17614 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:45:57 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] VM Stopped (Lifecycle Event)
Apr 12 07:45:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-08593585-72c8-4f63-908d-2a182ce49c30 None None] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:45:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:45:59 user nova-compute[82850]: INFO nova.compute.manager [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Unrescuing
Apr 12 07:45:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:45:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:45:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:45:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:45:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:45:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:00 user nova-compute[82850]: WARNING nova.compute.manager [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:46:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance destroyed successfully.
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:02 user nova-compute[82850]: WARNING nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:46:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:02 user nova-compute[82850]: WARNING nova.compute.manager [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:46:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285564.336111, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:04 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Resumed (Lifecycle Event)
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:04 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285564.337392, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:04 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Started (Lifecycle Event)
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:04 user nova-compute[82850]: WARNING nova.compute.manager [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state active and task_state None.
Apr 12 07:46:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:46:08 user nova-compute[82850]: INFO nova.compute.claims [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Claim successful on node user
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:46:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:46:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:46:09 user nova-compute[82850]: INFO nova.virt.block_device [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Booting with volume snapshot 32b6d063-9ea8-4ad2-8d90-96d8996c5e85 at /dev/vda
Apr 12 07:46:09 user nova-compute[82850]: DEBUG nova.policy [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:10 user nova-compute[82850]: INFO nova.compute.manager [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Detaching volume a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:46:10 user nova-compute[82850]: INFO nova.virt.block_device [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attempting to driver detach volume a63f5525-138b-4fd7-8ec1-59c92063ee9e from mountpoint /dev/vdb
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Attempting to detach device vdb from instance 3b7424e4-52aa-4330-a748-006240372716 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:46:10 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:10 user nova-compute[82850]:   <source dev="/dev/sdd"/>
Apr 12 07:46:10 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:46:10 user nova-compute[82850]:   <serial>a63f5525-138b-4fd7-8ec1-59c92063ee9e</serial>
Apr 12 07:46:10 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:46:10 user nova-compute[82850]: </disk>
Apr 12 07:46:10 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:46:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully detached device vdb from instance 3b7424e4-52aa-4330-a748-006240372716 from the persistent domain config.
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b7424e4-52aa-4330-a748-006240372716 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:46:10 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:10 user nova-compute[82850]:   <source dev="/dev/sdd"/>
Apr 12 07:46:10 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:46:10 user nova-compute[82850]:   <serial>a63f5525-138b-4fd7-8ec1-59c92063ee9e</serial>
Apr 12 07:46:10 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:46:10 user nova-compute[82850]: </disk>
Apr 12 07:46:10 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Successfully created port: 4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285570.7168438, 3b7424e4-52aa-4330-a748-006240372716 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:46:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully detached device vdb from instance 3b7424e4-52aa-4330-a748-006240372716 from the live domain config.
Apr 12 07:46:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTRaSUqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:10 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4a04f3-1649-46b1-9dd8-3cfe468ec0fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:46:10 user nova-compute[82850]: No targets found.
Apr 12 07:46:10 user nova-compute[82850]: iSNS:
Apr 12 07:46:10 user nova-compute[82850]: No targets found.
Apr 12 07:46:10 user nova-compute[82850]: STATIC:
Apr 12 07:46:10 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:46:10 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:46:10 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:46:10 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e
Apr 12 07:46:10 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:46:10 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:46:10 user nova-compute[82850]: FIRMWARE:
Apr 12 07:46:10 user nova-compute[82850]: No targets found.
Apr 12 07:46:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:46:10 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:46:10 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bbfd69-04cc-486d-ba16-972eb5eb6cf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceda327-2734-4f05-99a1-a75a885cc7ab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:46:10 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e (non-flash)
Apr 12 07:46:10 user nova-compute[82850]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c314430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e'): ({'sdd'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdd {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece4adc0-b94f-4d20-ad74-482944bd9551]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7eb86-c879-4f0f-9c8d-3b07cba4440e]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdd {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[410c303b-8bf6-4cc6-b673-e6b588301da8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4a013-64b0-4f61-ac5f-73b8a51b3419]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce317f-67ec-45bf-aa9d-b3d4d175f145]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fefbfa-adb3-4e77-bfba-8a70bcf9c377]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260]
Apr 12 07:46:11 user nova-compute[82850]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e, portal: 172.16.0.220,3260] successful.
Apr 12 07:46:11 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63f5525-138b-4fd7-8ec1-59c92063ee9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe2a2f-8778-4006-8fb3-338cbbb23da8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (315ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Successfully updated port: 4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-changed-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Refreshing instance network info cache due to event network-changed-4b7609bc-36a3-40bc-a911-644f8b0d1766. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Acquiring lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Updating instance_info_cache with network_info: [{"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Instance network_info: |[{"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Acquired lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.network.neutron [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Refreshing network info cache for port 4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'flavor' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.826s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:12 user nova-compute[82850]: DEBUG nova.network.neutron [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Updated VIF entry in instance network info cache for port 4b7609bc-36a3-40bc-a911-644f8b0d1766. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:46:12 user nova-compute[82850]: DEBUG nova.network.neutron [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Updating instance_info_cache with network_info: [{"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Releasing lock "refresh_cache-8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.utils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acd391-e6a7-428f-870d-77601b2e75af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db972f-df05-48d4-a79e-be627f9da3cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8f1e1-40c7-4605-82f9-2d6053b8e3ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f667a9d-8881-4edf-b082-9a7103922a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:46:15 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18455f10-0c2c-4dde-95b0-5ddcbcd3e05c]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG os_brick.utils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Updating existing volume attachment record: e4808dd1-e42e-49fe-8101-16f042dc4262 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:46:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7962MB free_disk=26.27042007446289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:46:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Creating image(s)
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Ensure instance console log exists: /opt/stack/data/nova/instances/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Start _get_guest_xml network_info=[{"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T07:46:06Z,direct_url=<?>,disk_format='qcow2',id=34ecb43c-aca7-4574-ae55-d63693cb2d4d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-962638813',owner='145931c86ba9489684b6eabb936b9738',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T07:46:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGBYHxbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5', 'attached_at': '', 'detached_at': '', 'volume_id': '98aa4ec2-0721-4589-9745-03f284555df0', 'serial': '98aa4ec2-0721-4589-9745-03f284555df0'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'e4808dd1-e42e-49fe-8101-16f042dc4262', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:46:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:19 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T07:46:06Z,direct_url=<?>,disk_format='qcow2',id=34ecb43c-aca7-4574-ae55-d63693cb2d4d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-962638813',owner='145931c86ba9489684b6eabb936b9738',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T07:46:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGBYHxbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:19 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:19 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:19 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:46:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68aef0a-240e-41e7-838e-f683ab27e962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:46:20 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d81daf-a383-427a-b59c-7cfb1ecfbd34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0] added
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[419af2ce-6212-4870-9b18-7b52f7a89514]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ed439-b6ea-40eb-b92e-fbe76722fb5e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGBYHxbk {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGBYHxbk" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16340f7-9198-470e-a5eb-8ca7c8d6eea8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGBYHxbk'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a7947d-4d1d-4438-9573-253e5bb24af6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd49bc7-c411-4d2c-b17b-e79c6849a1b1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1bf547-9695-4f1c-8b75-850734665aa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260]
Apr 12 07:46:20 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260] successful.
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[413ec3e2-7b91-4e4a-83c5-0e2002269632]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7d832-6ead-4f3b-84f6-d195fb7ec4b2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21754c93-7190-48f4-8287-3b459011839b]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGBYHxbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:46:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23762643763653362', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643763653362', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-749572181',id=19,image_ref='34ecb43c-aca7-4574-ae55-d63693cb2d4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-elx6rbwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11493924',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:46:09Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:46:21 user nova-compute[82850]:   <uuid>8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5</uuid>
Apr 12 07:46:21 user nova-compute[82850]:   <name>instance-00000013</name>
Apr 12 07:46:21 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:46:21 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:46:21 user nova-compute[82850]:   <metadata>
Apr 12 07:46:21 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:46:21 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-749572181</nova:name>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:46:19</nova:creationTime>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:46:21 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:46:21 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:owner>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:46:21 user nova-compute[82850]:       </nova:owner>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:root type="image" uuid="34ecb43c-aca7-4574-ae55-d63693cb2d4d"/>
Apr 12 07:46:21 user nova-compute[82850]:       <nova:ports>
Apr 12 07:46:21 user nova-compute[82850]:         <nova:port uuid="4b7609bc-36a3-40bc-a911-644f8b0d1766">
Apr 12 07:46:21 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 07:46:21 user nova-compute[82850]:         </nova:port>
Apr 12 07:46:21 user nova-compute[82850]:       </nova:ports>
Apr 12 07:46:21 user nova-compute[82850]:     </nova:instance>
Apr 12 07:46:21 user nova-compute[82850]:   </metadata>
Apr 12 07:46:21 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:46:21 user nova-compute[82850]:     <system>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="serial">8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5</entry>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="uuid">8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5</entry>
Apr 12 07:46:21 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:46:21 user nova-compute[82850]:     </system>
Apr 12 07:46:21 user nova-compute[82850]:   </sysinfo>
Apr 12 07:46:21 user nova-compute[82850]:   <os>
Apr 12 07:46:21 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:46:21 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:46:21 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:46:21 user nova-compute[82850]:   </os>
Apr 12 07:46:21 user nova-compute[82850]:   <features>
Apr 12 07:46:21 user nova-compute[82850]:     <acpi/>
Apr 12 07:46:21 user nova-compute[82850]:     <apic/>
Apr 12 07:46:21 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:46:21 user nova-compute[82850]:   </features>
Apr 12 07:46:21 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:46:21 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:46:21 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:46:21 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:46:21 user nova-compute[82850]:   </clock>
Apr 12 07:46:21 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:46:21 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:46:21 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:46:21 user nova-compute[82850]:   </cpu>
Apr 12 07:46:21 user nova-compute[82850]:   <devices>
Apr 12 07:46:21 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:46:21 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:21 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:46:21 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:46:21 user nova-compute[82850]:       <serial>98aa4ec2-0721-4589-9745-03f284555df0</serial>
Apr 12 07:46:21 user nova-compute[82850]:     </disk>
Apr 12 07:46:21 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:46:21 user nova-compute[82850]:       <mac address="fa:16:3e:91:3d:9a"/>
Apr 12 07:46:21 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:46:21 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:46:21 user nova-compute[82850]:       <target dev="tap4b7609bc-36"/>
Apr 12 07:46:21 user nova-compute[82850]:     </interface>
Apr 12 07:46:21 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:46:21 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5/console.log" append="off"/>
Apr 12 07:46:21 user nova-compute[82850]:     </serial>
Apr 12 07:46:21 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:46:21 user nova-compute[82850]:     <video>
Apr 12 07:46:21 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:46:21 user nova-compute[82850]:     </video>
Apr 12 07:46:21 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:46:21 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:46:21 user nova-compute[82850]:     </rng>
Apr 12 07:46:21 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:46:21 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:46:21 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:46:21 user nova-compute[82850]:     </memballoon>
Apr 12 07:46:21 user nova-compute[82850]:   </devices>
Apr 12 07:46:21 user nova-compute[82850]: </domain>
Apr 12 07:46:21 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-749572181',id=19,image_ref='34ecb43c-aca7-4574-ae55-d63693cb2d4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-elx6rbwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11493924',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:46:09Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG os_vif [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b7609bc-36, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b7609bc-36, col_values=(('external_ids', {'iface-id': '4b7609bc-36a3-40bc-a911-644f8b0d1766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:3d:9a', 'vm-uuid': '8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:21 user nova-compute[82850]: INFO os_vif [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36')
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:91:3d:9a, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [{"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-69aeabdc-65e3-4af2-9f8b-3699778c6b89" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] No waiting events found dispatching network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:22 user nova-compute[82850]: WARNING nova.compute.manager [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received unexpected event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance with vm_state building and task_state spawning.
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] No waiting events found dispatching network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:24 user nova-compute[82850]: WARNING nova.compute.manager [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received unexpected event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance with vm_state building and task_state spawning.
Apr 12 07:46:24 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285584.993575, 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:24 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] VM Resumed (Lifecycle Event)
Apr 12 07:46:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:46:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Instance spawned successfully.
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285584.9953797, 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] VM Started (Lifecycle Event)
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Took 5.16 seconds to spawn the instance on the hypervisor.
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:46:25 user nova-compute[82850]: INFO nova.compute.manager [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Took 16.32 seconds to build instance.
Apr 12 07:46:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.656s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing instance network info cache due to event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Acquiring lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Acquired lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG nova.network.neutron [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:30 user nova-compute[82850]: INFO nova.compute.manager [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attaching volume 0b3a52e6-052a-43bf-a817-207c82b3dc3b to /dev/vdb
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.utils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updated VIF entry in instance network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating instance_info_cache with network_info: [{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e5353c-bb96-40ac-b5d2-41908eb5d669]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Releasing lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c4283d-4c73-45bf-91ae-61aa5be39609]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4066a-062a-4390-a509-bbafdecf68ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52151363-1d08-4e18-b840-a8976fb2e1ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:46:30 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:46:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da741eb3-25fd-4433-9e53-aebc212fe30b]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG os_brick.utils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating existing volume attachment record: c3bf5bc5-409b-43ae-98b6-4fdb23751776 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpUgqskI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:34 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ff4b9-9f58-4f5f-a8d6-3fa5c6b5aa03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:46:34 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61960238-caeb-41af-b8ef-e5b7e6842010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b] added
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9309181-76d8-4dc6-9e53-349f2f1df223]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a5f93-1387-4a5b-a4ae-f6dc197416d5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpUgqskI {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpUgqskI" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbeefa2-e049-47ef-b8e2-0f9d7f9b6c3e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpUgqskI'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd96c72-6880-4875-9e46-7dd963137294]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a35062-ac40-47f0-8114-c3f185e519a9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1900209b-f815-43cf-bdf7-daf5009ce5b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260]
Apr 12 07:46:34 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260] successful.
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d8859e-d924-41d8-a5d0-324069f02889]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8a2be-7186-4902-817b-f89546f6caad]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:34 user nova-compute[82850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)
Apr 12 07:46:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd0e7e5-bb22-49b6-b5ac-330beff85f2f]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:46:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpUgqskI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26130303065306365', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130303065306365', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:46:35 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:35 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:46:35 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:46:35 user nova-compute[82850]:   <serial>0b3a52e6-052a-43bf-a817-207c82b3dc3b</serial>
Apr 12 07:46:35 user nova-compute[82850]: </disk>
Apr 12 07:46:35 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No VIF found with MAC fa:16:3e:04:2c:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:46:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.563s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:41 user nova-compute[82850]: INFO nova.compute.manager [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Terminating instance
Apr 12 07:46:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-unplugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:46:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Instance destroyed successfully.
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'resources' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2050028382',display_name='tempest-ServerStableDeviceRescueTest-server-2050028382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2050028382',id=7,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqw+fRFEXzo2E8zYD8tNpcWZ3Dbiukx9cAFsZUU+hROJOSEqpmsx5UgbhAUOur9dqTbsQ7BQg01ufaydX8WNt+5So3ZMdUF8LLxFa/deh6yQ8CHMyjzOmnF4ex9Z+eEQQ==',key_name='tempest-keypair-777808843',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3578114ca9476ca280abc2e4f83b11',ramdisk_id='',reservation_id='r-hrepuju0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-473420304',owner_user_name='tempest-ServerStableDeviceRescueTest-473420304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3d67cdd754c467dbe2760ede6f4218d',uuid=69aeabdc-65e3-4af2-9f8b-3699778c6b89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converting VIF {"id": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "address": "fa:16:3e:71:22:82", "network": {"id": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1032432216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3578114ca9476ca280abc2e4f83b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b334cc7-e1", "ovs_interfaceid": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG os_vif [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b334cc7-e1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:42 user nova-compute[82850]: INFO os_vif [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:22:82,bridge_name='br-int',has_traffic_filtering=True,id=0b334cc7-e101-4fdc-9a60-98cf9c11d7ca,network=Network(d06c5fb1-62e9-426f-a223-7b4e4a89be8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b334cc7-e1')
Apr 12 07:46:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Deleting instance files /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89_del
Apr 12 07:46:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Deletion of /opt/stack/data/nova/instances/69aeabdc-65e3-4af2-9f8b-3699778c6b89_del complete
Apr 12 07:46:42 user nova-compute[82850]: INFO nova.compute.manager [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 07:46:42 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:46:42 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:43 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Took 0.85 seconds to deallocate network for instance.
Apr 12 07:46:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-deleted-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:46:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:43 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Deleted allocations for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89
Apr 12 07:46:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Acquiring lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Lock "69aeabdc-65e3-4af2-9f8b-3699778c6b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] No waiting events found dispatching network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:44 user nova-compute[82850]: WARNING nova.compute.manager [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Received unexpected event network-vif-plugged-0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance with vm_state deleted and task_state None.
Apr 12 07:46:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:46 user nova-compute[82850]: INFO nova.compute.manager [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Detaching volume 0b3a52e6-052a-43bf-a817-207c82b3dc3b
Apr 12 07:46:46 user nova-compute[82850]: INFO nova.virt.block_device [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attempting to driver detach volume 0b3a52e6-052a-43bf-a817-207c82b3dc3b from mountpoint /dev/vdb
Apr 12 07:46:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Attempting to detach device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:46:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:46:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:46 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:46:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:46:46 user nova-compute[82850]:   <serial>0b3a52e6-052a-43bf-a817-207c82b3dc3b</serial>
Apr 12 07:46:46 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:46:46 user nova-compute[82850]: </disk>
Apr 12 07:46:46 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:46:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config.
Apr 12 07:46:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:46:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:46:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:46:46 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:46:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:46:46 user nova-compute[82850]:   <serial>0b3a52e6-052a-43bf-a817-207c82b3dc3b</serial>
Apr 12 07:46:46 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:46:46 user nova-compute[82850]: </disk>
Apr 12 07:46:46 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285607.3790216, 31672149-0612-4e15-aacd-e37c7536109c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:46:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config.
Apr 12 07:46:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpUgqskI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:46:47 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d676215b-76ad-43b3-8850-0dfcfa7cb211]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:46:47 user nova-compute[82850]: No targets found.
Apr 12 07:46:47 user nova-compute[82850]: iSNS:
Apr 12 07:46:47 user nova-compute[82850]: No targets found.
Apr 12 07:46:47 user nova-compute[82850]: STATIC:
Apr 12 07:46:47 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b
Apr 12 07:46:47 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:46:47 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:46:47 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:46:47 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:46:47 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:46:47 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0
Apr 12 07:46:47 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:46:47 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:46:47 user nova-compute[82850]: FIRMWARE:
Apr 12 07:46:47 user nova-compute[82850]: No targets found.
Apr 12 07:46:47 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:46:47 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:46:47 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9fc13a-9cea-4c02-8a93-8f1033c52784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eed3d1e-4ac2-4fdb-a699-25cf8b852695]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:47 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:47 user nova-compute[82850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)
Apr 12 07:46:47 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:46:47 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:46:47 user nova-compute[82850]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b (non-flash)
Apr 12 07:46:47 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c3152d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf725ee9-d9ec-4aa9-ab17-cb1c1e5c4761]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ad012c-f6ae-4b24-9e2a-4faf59dddf2d]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06925d43-7329-40ef-b670-c6a76d58cd38]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c108409-573b-415e-a3ef-def5440ffddb]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c5319-ddf9-430e-88bb-64d0b573ae4d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2214674-cea8-49a4-9a13-9342fa4e75df]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260]
Apr 12 07:46:47 user nova-compute[82850]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b, portal: 172.16.0.220,3260] successful.
Apr 12 07:46:47 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3a52e6-052a-43bf-a817-207c82b3dc3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7005df-ca34-45bf-9ab2-7fdb70457530]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== disconnect_volume: return (318ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:46:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.923s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:51 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:46:51 user nova-compute[82850]: INFO nova.compute.claims [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Claim successful on node user
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:46:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.policy [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:46:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Creating image(s)
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk 1073741824" returned: 0 in 0.050s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Successfully created port: 28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Cannot resize image /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:46:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'migration_context' on Instance uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Ensure instance console log exists: /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Successfully updated port: 28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-changed-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Refreshing instance network info cache due to event network-changed-28f429c2-3e75-45e6-b544-e3dfc70c9a67. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:46:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Instance network_info: |[{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Refreshing network info cache for port 28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Start _get_guest_xml network_info=[{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:46:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-341409038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-341409038',id=20,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-ejp6htxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:46:52Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=6c911478-0ca8-4d4c-9875-2497b6307a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:46:54 user nova-compute[82850]:   <uuid>6c911478-0ca8-4d4c-9875-2497b6307a6d</uuid>
Apr 12 07:46:54 user nova-compute[82850]:   <name>instance-00000014</name>
Apr 12 07:46:54 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:46:54 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:46:54 user nova-compute[82850]:   <metadata>
Apr 12 07:46:54 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:46:54 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-341409038</nova:name>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:46:54</nova:creationTime>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:46:54 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:46:54 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:owner>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 07:46:54 user nova-compute[82850]:       </nova:owner>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:46:54 user nova-compute[82850]:       <nova:ports>
Apr 12 07:46:54 user nova-compute[82850]:         <nova:port uuid="28f429c2-3e75-45e6-b544-e3dfc70c9a67">
Apr 12 07:46:54 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 07:46:54 user nova-compute[82850]:         </nova:port>
Apr 12 07:46:54 user nova-compute[82850]:       </nova:ports>
Apr 12 07:46:54 user nova-compute[82850]:     </nova:instance>
Apr 12 07:46:54 user nova-compute[82850]:   </metadata>
Apr 12 07:46:54 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:46:54 user nova-compute[82850]:     <system>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="serial">6c911478-0ca8-4d4c-9875-2497b6307a6d</entry>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="uuid">6c911478-0ca8-4d4c-9875-2497b6307a6d</entry>
Apr 12 07:46:54 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:46:54 user nova-compute[82850]:     </system>
Apr 12 07:46:54 user nova-compute[82850]:   </sysinfo>
Apr 12 07:46:54 user nova-compute[82850]:   <os>
Apr 12 07:46:54 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:46:54 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:46:54 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:46:54 user nova-compute[82850]:   </os>
Apr 12 07:46:54 user nova-compute[82850]:   <features>
Apr 12 07:46:54 user nova-compute[82850]:     <acpi/>
Apr 12 07:46:54 user nova-compute[82850]:     <apic/>
Apr 12 07:46:54 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:46:54 user nova-compute[82850]:   </features>
Apr 12 07:46:54 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:46:54 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:46:54 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:46:54 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:46:54 user nova-compute[82850]:   </clock>
Apr 12 07:46:54 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:46:54 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:46:54 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:46:54 user nova-compute[82850]:   </cpu>
Apr 12 07:46:54 user nova-compute[82850]:   <devices>
Apr 12 07:46:54 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:46:54 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:46:54 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk"/>
Apr 12 07:46:54 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:46:54 user nova-compute[82850]:     </disk>
Apr 12 07:46:54 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:46:54 user nova-compute[82850]:       <mac address="fa:16:3e:25:90:04"/>
Apr 12 07:46:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:46:54 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:46:54 user nova-compute[82850]:       <target dev="tap28f429c2-3e"/>
Apr 12 07:46:54 user nova-compute[82850]:     </interface>
Apr 12 07:46:54 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:46:54 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/console.log" append="off"/>
Apr 12 07:46:54 user nova-compute[82850]:     </serial>
Apr 12 07:46:54 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:46:54 user nova-compute[82850]:     <video>
Apr 12 07:46:54 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:46:54 user nova-compute[82850]:     </video>
Apr 12 07:46:54 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:46:54 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:46:54 user nova-compute[82850]:     </rng>
Apr 12 07:46:54 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:46:54 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:46:54 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:46:54 user nova-compute[82850]:     </memballoon>
Apr 12 07:46:54 user nova-compute[82850]:   </devices>
Apr 12 07:46:54 user nova-compute[82850]: </domain>
Apr 12 07:46:54 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-341409038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-341409038',id=20,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-ejp6htxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:46:52Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=6c911478-0ca8-4d4c-9875-2497b6307a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG os_vif [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28f429c2-3e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28f429c2-3e, col_values=(('external_ids', {'iface-id': '28f429c2-3e75-45e6-b544-e3dfc70c9a67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:90:04', 'vm-uuid': '6c911478-0ca8-4d4c-9875-2497b6307a6d'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:54 user nova-compute[82850]: INFO os_vif [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e')
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:46:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:25:90:04, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:46:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updated VIF entry in instance network info cache for port 28f429c2-3e75-45e6-b544-e3dfc70c9a67. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:46:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:46:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:46:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] No waiting events found dispatching network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:56 user nova-compute[82850]: WARNING nova.compute.manager [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received unexpected event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance with vm_state building and task_state spawning.
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:46:57 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285602.4670074, 69aeabdc-65e3-4af2-9f8b-3699778c6b89 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:57 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] VM Stopped (Lifecycle Event)
Apr 12 07:46:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f8deefeb-55f1-4094-88cb-235bc588e653 None None] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285618.378019, 6c911478-0ca8-4d4c-9875-2497b6307a6d => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] VM Resumed (Lifecycle Event)
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Instance spawned successfully.
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285618.3839726, 6c911478-0ca8-4d4c-9875-2497b6307a6d => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] VM Started (Lifecycle Event)
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Took 6.15 seconds to spawn the instance on the hypervisor.
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] No waiting events found dispatching network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:46:58 user nova-compute[82850]: WARNING nova.compute.manager [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received unexpected event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance with vm_state building and task_state spawning.
Apr 12 07:46:58 user nova-compute[82850]: INFO nova.compute.manager [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Took 6.83 seconds to build instance.
Apr 12 07:46:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:46:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquired lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:47:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'info_cache' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Releasing lock "refresh_cache-f79ca8ec-41b5-4b60-882f-d74d906fb8e6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:47:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance destroyed successfully.
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'resources' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG os_vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40ca8897-71, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:47:05 user nova-compute[82850]: INFO os_vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start _get_guest_xml network_info=[{"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'numa_topology' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:05 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:05 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'vcpu_model' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'pci_devices' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:47:05 user nova-compute[82850]:   <uuid>f79ca8ec-41b5-4b60-882f-d74d906fb8e6</uuid>
Apr 12 07:47:05 user nova-compute[82850]:   <name>instance-00000006</name>
Apr 12 07:47:05 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:47:05 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:47:05 user nova-compute[82850]:   <metadata>
Apr 12 07:47:05 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:47:05 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeTestJSON-server-1794309151</nova:name>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:47:05</nova:creationTime>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:47:05 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:47:05 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:owner>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:user uuid="a555fa5e6680420e80fcc925a7540806">tempest-AttachVolumeTestJSON-1353175840-project-member</nova:user>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:project uuid="f7915d29fb124c838093eba0ee6cb69c">tempest-AttachVolumeTestJSON-1353175840</nova:project>
Apr 12 07:47:05 user nova-compute[82850]:       </nova:owner>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:47:05 user nova-compute[82850]:       <nova:ports>
Apr 12 07:47:05 user nova-compute[82850]:         <nova:port uuid="40ca8897-7180-4ef1-91f2-29b18afbcc25">
Apr 12 07:47:05 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:47:05 user nova-compute[82850]:         </nova:port>
Apr 12 07:47:05 user nova-compute[82850]:       </nova:ports>
Apr 12 07:47:05 user nova-compute[82850]:     </nova:instance>
Apr 12 07:47:05 user nova-compute[82850]:   </metadata>
Apr 12 07:47:05 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:47:05 user nova-compute[82850]:     <system>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="serial">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="uuid">f79ca8ec-41b5-4b60-882f-d74d906fb8e6</entry>
Apr 12 07:47:05 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:47:05 user nova-compute[82850]:     </system>
Apr 12 07:47:05 user nova-compute[82850]:   </sysinfo>
Apr 12 07:47:05 user nova-compute[82850]:   <os>
Apr 12 07:47:05 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:47:05 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:47:05 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:47:05 user nova-compute[82850]:   </os>
Apr 12 07:47:05 user nova-compute[82850]:   <features>
Apr 12 07:47:05 user nova-compute[82850]:     <acpi/>
Apr 12 07:47:05 user nova-compute[82850]:     <apic/>
Apr 12 07:47:05 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:47:05 user nova-compute[82850]:   </features>
Apr 12 07:47:05 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:47:05 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:47:05 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:47:05 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:47:05 user nova-compute[82850]:   </clock>
Apr 12 07:47:05 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:47:05 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:47:05 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:47:05 user nova-compute[82850]:   </cpu>
Apr 12 07:47:05 user nova-compute[82850]:   <devices>
Apr 12 07:47:05 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:47:05 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:47:05 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk"/>
Apr 12 07:47:05 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:47:05 user nova-compute[82850]:     </disk>
Apr 12 07:47:05 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:47:05 user nova-compute[82850]:       <mac address="fa:16:3e:b7:ec:08"/>
Apr 12 07:47:05 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:05 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:47:05 user nova-compute[82850]:       <target dev="tap40ca8897-71"/>
Apr 12 07:47:05 user nova-compute[82850]:     </interface>
Apr 12 07:47:05 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:47:05 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/console.log" append="off"/>
Apr 12 07:47:05 user nova-compute[82850]:     </serial>
Apr 12 07:47:05 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:47:05 user nova-compute[82850]:     <video>
Apr 12 07:47:05 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:05 user nova-compute[82850]:     </video>
Apr 12 07:47:05 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:47:05 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:47:05 user nova-compute[82850]:     </rng>
Apr 12 07:47:05 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:47:05 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:47:05 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:47:05 user nova-compute[82850]:     </memballoon>
Apr 12 07:47:05 user nova-compute[82850]:   </devices>
Apr 12 07:47:05 user nova-compute[82850]: </domain>
Apr 12 07:47:05 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'trusted_certs' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Cannot resize image /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'migration_context' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG os_vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40ca8897-71, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40ca8897-71, col_values=(('external_ids', {'iface-id': '40ca8897-7180-4ef1-91f2-29b18afbcc25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ec:08', 'vm-uuid': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:47:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:06 user nova-compute[82850]: INFO os_vif [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:47:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:47:07 user nova-compute[82850]: WARNING nova.compute.manager [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state powering-on.
Apr 12 07:47:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:47:09 user nova-compute[82850]: WARNING nova.compute.manager [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state stopped and task_state powering-on.
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285630.053486, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:47:10 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Resumed (Lifecycle Event)
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:47:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance rebooted successfully.
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:47:10 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285630.0557141, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:47:10 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Started (Lifecycle Event)
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:47:10 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 07:47:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:16 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:16 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:47:17 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:21 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=26.327007293701172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:47:21 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:47:22 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:47:22 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:47:22 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:47:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:47:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:47:33 user nova-compute[82850]: INFO nova.compute.claims [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Claim successful on node user
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:47:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.policy [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:47:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Creating image(s)
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "/opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "/opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "/opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk 1073741824" returned: 0 in 0.047s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Cannot resize image /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'migration_context' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Ensure instance console log exists: /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Successfully created port: c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Successfully updated port: c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquired lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-changed-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Refreshing instance network info cache due to event network-changed-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Acquiring lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Updating instance_info_cache with network_info: [{"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Releasing lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Instance network_info: |[{"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Acquired lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.neutron [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Refreshing network info cache for port c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Start _get_guest_xml network_info=[{"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:47:35 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:35 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989365315',display_name='tempest-VolumesSnapshotTestJSON-instance-989365315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989365315',id=21,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-s5pxbcql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:47:34Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=00258d37-14c7-4657-b9c4-c636c93811ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'pci_devices' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:47:35 user nova-compute[82850]:   <uuid>00258d37-14c7-4657-b9c4-c636c93811ce</uuid>
Apr 12 07:47:35 user nova-compute[82850]:   <name>instance-00000015</name>
Apr 12 07:47:35 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:47:35 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:47:35 user nova-compute[82850]:   <metadata>
Apr 12 07:47:35 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:47:35 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-989365315</nova:name>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:47:35</nova:creationTime>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:47:35 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:47:35 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:owner>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:user uuid="76d4eef76f634fb39c1f0895abfbd17d">tempest-VolumesSnapshotTestJSON-1434579998-project-member</nova:user>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:project uuid="468e9932c7634b0d8c3257ee14a66959">tempest-VolumesSnapshotTestJSON-1434579998</nova:project>
Apr 12 07:47:35 user nova-compute[82850]:       </nova:owner>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:47:35 user nova-compute[82850]:       <nova:ports>
Apr 12 07:47:35 user nova-compute[82850]:         <nova:port uuid="c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929">
Apr 12 07:47:35 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 07:47:35 user nova-compute[82850]:         </nova:port>
Apr 12 07:47:35 user nova-compute[82850]:       </nova:ports>
Apr 12 07:47:35 user nova-compute[82850]:     </nova:instance>
Apr 12 07:47:35 user nova-compute[82850]:   </metadata>
Apr 12 07:47:35 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:47:35 user nova-compute[82850]:     <system>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="serial">00258d37-14c7-4657-b9c4-c636c93811ce</entry>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="uuid">00258d37-14c7-4657-b9c4-c636c93811ce</entry>
Apr 12 07:47:35 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:47:35 user nova-compute[82850]:     </system>
Apr 12 07:47:35 user nova-compute[82850]:   </sysinfo>
Apr 12 07:47:35 user nova-compute[82850]:   <os>
Apr 12 07:47:35 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:47:35 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:47:35 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:47:35 user nova-compute[82850]:   </os>
Apr 12 07:47:35 user nova-compute[82850]:   <features>
Apr 12 07:47:35 user nova-compute[82850]:     <acpi/>
Apr 12 07:47:35 user nova-compute[82850]:     <apic/>
Apr 12 07:47:35 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:47:35 user nova-compute[82850]:   </features>
Apr 12 07:47:35 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:47:35 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:47:35 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:47:35 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:47:35 user nova-compute[82850]:   </clock>
Apr 12 07:47:35 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:47:35 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:47:35 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:47:35 user nova-compute[82850]:   </cpu>
Apr 12 07:47:35 user nova-compute[82850]:   <devices>
Apr 12 07:47:35 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:47:35 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:47:35 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk"/>
Apr 12 07:47:35 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:47:35 user nova-compute[82850]:     </disk>
Apr 12 07:47:35 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:47:35 user nova-compute[82850]:       <mac address="fa:16:3e:83:5b:56"/>
Apr 12 07:47:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:35 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:47:35 user nova-compute[82850]:       <target dev="tapc5aa0b1a-8e"/>
Apr 12 07:47:35 user nova-compute[82850]:     </interface>
Apr 12 07:47:35 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:47:35 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/console.log" append="off"/>
Apr 12 07:47:35 user nova-compute[82850]:     </serial>
Apr 12 07:47:35 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:47:35 user nova-compute[82850]:     <video>
Apr 12 07:47:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:35 user nova-compute[82850]:     </video>
Apr 12 07:47:35 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:47:35 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:47:35 user nova-compute[82850]:     </rng>
Apr 12 07:47:35 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:47:35 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:47:35 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:47:35 user nova-compute[82850]:     </memballoon>
Apr 12 07:47:35 user nova-compute[82850]:   </devices>
Apr 12 07:47:35 user nova-compute[82850]: </domain>
Apr 12 07:47:35 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989365315',display_name='tempest-VolumesSnapshotTestJSON-instance-989365315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989365315',id=21,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-s5pxbcql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:47:34Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=00258d37-14c7-4657-b9c4-c636c93811ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG os_vif [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5aa0b1a-8e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5aa0b1a-8e, col_values=(('external_ids', {'iface-id': 'c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5b:56', 'vm-uuid': '00258d37-14c7-4657-b9c4-c636c93811ce'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:35 user nova-compute[82850]: INFO os_vif [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e')
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:47:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No VIF found with MAC fa:16:3e:83:5b:56, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:47:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Updated VIF entry in instance network info cache for port c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:47:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Updating instance_info_cache with network_info: [{"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:47:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Releasing lock "refresh_cache-00258d37-14c7-4657-b9c4-c636c93811ce" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] No waiting events found dispatching network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:47:37 user nova-compute[82850]: WARNING nova.compute.manager [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received unexpected event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance with vm_state building and task_state spawning.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285659.4159007, 00258d37-14c7-4657-b9c4-c636c93811ce => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] VM Resumed (Lifecycle Event)
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Instance spawned successfully.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] No waiting events found dispatching network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:47:39 user nova-compute[82850]: WARNING nova.compute.manager [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received unexpected event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance with vm_state building and task_state spawning.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285659.4198563, 00258d37-14c7-4657-b9c4-c636c93811ce => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] VM Started (Lifecycle Event)
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:47:39 user nova-compute[82850]: INFO nova.compute.manager [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Took 6.48 seconds to build instance.
Apr 12 07:47:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:40 user nova-compute[82850]: INFO nova.compute.manager [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attaching volume 077784be-9724-4872-a5c7-11f2fd1ebf64 to /dev/vdb
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.utils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354aa65-9ce5-47e5-ad4c-46d4aecda7ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c42a7-bd8e-4931-be44-d18bf5e21cce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232e9ff-4be5-4830-998b-3d577d3c0995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f164b83-fc8a-457c-8866-74587ea250c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:47:40 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:47:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52247f6-d49f-4373-8f8b-bceb3cde8598]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG os_brick.utils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating existing volume attachment record: 97ff263d-0e25-4729-a7e7-1bcf694b4309 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTBDLPhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:47:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:47:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:47:45 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fb179-2476-4aa5-833d-27752badb145]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:47:45 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[54653a2c-3328-423a-9028-c5c033997eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64] added
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[928cb440-d4a0-4eae-bb6f-a5d3aff24622]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119459f-f9db-4d66-9166-d81dac94a8a1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTBDLPhN {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTBDLPhN" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28809066-d7ee-42d3-ba0f-9e1e3af2fef5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTBDLPhN'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6910f3-3745-40f0-8d8c-bdb6a8115541]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae36b03-96b9-43f3-80e8-20b039aa8a50]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[80505dcd-4714-43e8-a012-01468413ab83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260]
Apr 12 07:47:45 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260] successful.
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81683609-105b-489f-804f-24f7fec90df4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee8a19d-0bce-44b3-b091-ace3de76d464]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)
Apr 12 07:47:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ee6d73-9e6d-46d2-ae81-c24424b02618]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTBDLPhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:47:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:47:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23163316632633662', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:47:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163316632633662', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:47:46 user nova-compute[82850]: DEBUG nova.objects.instance [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:47:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:47:46 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:47:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:47:46 user nova-compute[82850]:   <serial>077784be-9724-4872-a5c7-11f2fd1ebf64</serial>
Apr 12 07:47:46 user nova-compute[82850]: </disk>
Apr 12 07:47:46 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:47:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:47:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:47:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No VIF found with MAC fa:16:3e:04:2c:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:47:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.861s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:48 user nova-compute[82850]: INFO nova.compute.manager [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Detaching volume 077784be-9724-4872-a5c7-11f2fd1ebf64
Apr 12 07:47:48 user nova-compute[82850]: INFO nova.virt.block_device [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attempting to driver detach volume 077784be-9724-4872-a5c7-11f2fd1ebf64 from mountpoint /dev/vdb
Apr 12 07:47:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Attempting to detach device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:47:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:47:48 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:47:48 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:47:48 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:47:48 user nova-compute[82850]:   <serial>077784be-9724-4872-a5c7-11f2fd1ebf64</serial>
Apr 12 07:47:48 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:47:48 user nova-compute[82850]: </disk>
Apr 12 07:47:48 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:47:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config.
Apr 12 07:47:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:47:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:47:48 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:47:48 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:47:48 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:47:48 user nova-compute[82850]:   <serial>077784be-9724-4872-a5c7-11f2fd1ebf64</serial>
Apr 12 07:47:48 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:47:48 user nova-compute[82850]: </disk>
Apr 12 07:47:48 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285669.2760272, 31672149-0612-4e15-aacd-e37c7536109c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:47:49 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config.
Apr 12 07:47:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTBDLPhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:47:49 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51376500-2bd3-4994-8ee9-835677a00770]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:47:49 user nova-compute[82850]: No targets found.
Apr 12 07:47:49 user nova-compute[82850]: iSNS:
Apr 12 07:47:49 user nova-compute[82850]: No targets found.
Apr 12 07:47:49 user nova-compute[82850]: STATIC:
Apr 12 07:47:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:47:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:47:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:47:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0
Apr 12 07:47:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:47:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:47:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64
Apr 12 07:47:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:47:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:47:49 user nova-compute[82850]: FIRMWARE:
Apr 12 07:47:49 user nova-compute[82850]: No targets found.
Apr 12 07:47:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:47:49 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:47:49 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58ea7f-0c5b-467b-9e3c-5d5a3c8bbd2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0a89e-8e7e-4967-9199-cf156f21339f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 (non-flash)
Apr 12 07:47:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0f77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3882ec-df21-477d-af5c-d41a094358ea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c231da5-8ecd-4e66-8c58-ea81b7a200a5]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f44c04-f694-4520-9774-e99e80f97919]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1dd09d-5126-4e55-a395-f07737adcb40]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fde350-3f90-4b64-b8f9-974c48e31d7e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[99536e67-d696-4f12-abb8-f8c4780c210c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260]
Apr 12 07:47:49 user nova-compute[82850]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64, portal: 172.16.0.220,3260] successful.
Apr 12 07:47:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077784be-9724-4872-a5c7-11f2fd1ebf64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0fb612-1a4b-416a-9d97-3b59e2d35f31]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== disconnect_volume: return (331ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:47:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:47:50 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:47:54 user nova-compute[82850]: INFO nova.compute.claims [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Claim successful on node user
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:47:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:47:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Creating image(s)
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk 1073741824" returned: 0 in 0.072s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.policy [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Cannot resize image /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.objects.instance [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Ensure instance console log exists: /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Successfully created port: 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Successfully updated port: 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing instance network info cache due to event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:47:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance network_info: |[{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start _get_guest_xml network_info=[{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:47:57 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:57 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976346504',display_name='tempest-ServerRescueNegativeTestJSON-server-1976346504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1976346504',id=22,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqGGXXPtvQkc4Q+1b1tPxLW6NgPiaphqfUdgbK5JXJXP525ewACIqwvdzXe6oF4g+7xY5gbo/sFkRUpVm0ItlkNFkuEY1IfoP9Pq3jpaEgq3F2toZknWB7N0LTVnEYTQg==',key_name='tempest-keypair-44620121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-xjamlmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86009132a34b466399da1701f47316d9',uuid=2d96b11f-6cb6-4d16-acd3-94f7ae0c2350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.objects.instance [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:47:57 user nova-compute[82850]:   <uuid>2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</uuid>
Apr 12 07:47:57 user nova-compute[82850]:   <name>instance-00000016</name>
Apr 12 07:47:57 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:47:57 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:47:57 user nova-compute[82850]:   <metadata>
Apr 12 07:47:57 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:47:57 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1976346504</nova:name>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:47:57</nova:creationTime>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:47:57 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:47:57 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:owner>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:47:57 user nova-compute[82850]:       </nova:owner>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:47:57 user nova-compute[82850]:       <nova:ports>
Apr 12 07:47:57 user nova-compute[82850]:         <nova:port uuid="2805f98a-2ed0-4f69-b952-25ebe25cf704">
Apr 12 07:47:57 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:47:57 user nova-compute[82850]:         </nova:port>
Apr 12 07:47:57 user nova-compute[82850]:       </nova:ports>
Apr 12 07:47:57 user nova-compute[82850]:     </nova:instance>
Apr 12 07:47:57 user nova-compute[82850]:   </metadata>
Apr 12 07:47:57 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:47:57 user nova-compute[82850]:     <system>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="serial">2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</entry>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="uuid">2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</entry>
Apr 12 07:47:57 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:47:57 user nova-compute[82850]:     </system>
Apr 12 07:47:57 user nova-compute[82850]:   </sysinfo>
Apr 12 07:47:57 user nova-compute[82850]:   <os>
Apr 12 07:47:57 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:47:57 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:47:57 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:47:57 user nova-compute[82850]:   </os>
Apr 12 07:47:57 user nova-compute[82850]:   <features>
Apr 12 07:47:57 user nova-compute[82850]:     <acpi/>
Apr 12 07:47:57 user nova-compute[82850]:     <apic/>
Apr 12 07:47:57 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:47:57 user nova-compute[82850]:   </features>
Apr 12 07:47:57 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:47:57 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:47:57 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:47:57 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:47:57 user nova-compute[82850]:   </clock>
Apr 12 07:47:57 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:47:57 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:47:57 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:47:57 user nova-compute[82850]:   </cpu>
Apr 12 07:47:57 user nova-compute[82850]:   <devices>
Apr 12 07:47:57 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:47:57 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:47:57 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk"/>
Apr 12 07:47:57 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:47:57 user nova-compute[82850]:     </disk>
Apr 12 07:47:57 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:47:57 user nova-compute[82850]:       <mac address="fa:16:3e:cd:6b:30"/>
Apr 12 07:47:57 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:57 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:47:57 user nova-compute[82850]:       <target dev="tap2805f98a-2e"/>
Apr 12 07:47:57 user nova-compute[82850]:     </interface>
Apr 12 07:47:57 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:47:57 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/console.log" append="off"/>
Apr 12 07:47:57 user nova-compute[82850]:     </serial>
Apr 12 07:47:57 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:47:57 user nova-compute[82850]:     <video>
Apr 12 07:47:57 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:47:57 user nova-compute[82850]:     </video>
Apr 12 07:47:57 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:47:57 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:47:57 user nova-compute[82850]:     </rng>
Apr 12 07:47:57 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:47:57 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:47:57 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:47:57 user nova-compute[82850]:     </memballoon>
Apr 12 07:47:57 user nova-compute[82850]:   </devices>
Apr 12 07:47:57 user nova-compute[82850]: </domain>
Apr 12 07:47:57 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976346504',display_name='tempest-ServerRescueNegativeTestJSON-server-1976346504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1976346504',id=22,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqGGXXPtvQkc4Q+1b1tPxLW6NgPiaphqfUdgbK5JXJXP525ewACIqwvdzXe6oF4g+7xY5gbo/sFkRUpVm0ItlkNFkuEY1IfoP9Pq3jpaEgq3F2toZknWB7N0LTVnEYTQg==',key_name='tempest-keypair-44620121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-xjamlmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86009132a34b466399da1701f47316d9',uuid=2d96b11f-6cb6-4d16-acd3-94f7ae0c2350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG os_vif [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2805f98a-2e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2805f98a-2e, col_values=(('external_ids', {'iface-id': '2805f98a-2ed0-4f69-b952-25ebe25cf704', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:6b:30', 'vm-uuid': '2d96b11f-6cb6-4d16-acd3-94f7ae0c2350'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:57 user nova-compute[82850]: INFO os_vif [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e')
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:cd:6b:30, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updated VIF entry in instance network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:47:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:47:58 user nova-compute[82850]: WARNING nova.compute.manager [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state building and task_state spawning.
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: INFO nova.compute.manager [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Terminating instance
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Instance destroyed successfully.
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-749572181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-749572181',id=19,image_ref='34ecb43c-aca7-4574-ae55-d63693cb2d4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-elx6rbwm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11493924',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:46:25Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "address": "fa:16:3e:91:3d:9a", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7609bc-36", "ovs_interfaceid": "4b7609bc-36a3-40bc-a911-644f8b0d1766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_vif [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b7609bc-36, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:47:59 user nova-compute[82850]: INFO os_vif [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3d:9a,bridge_name='br-int',has_traffic_filtering=True,id=4b7609bc-36a3-40bc-a911-644f8b0d1766,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7609bc-36')
Apr 12 07:47:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGBYHxbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:47:59 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c6cf1-2065-4465-812a-0591cb21e57b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:47:59 user nova-compute[82850]: No targets found.
Apr 12 07:47:59 user nova-compute[82850]: iSNS:
Apr 12 07:47:59 user nova-compute[82850]: No targets found.
Apr 12 07:47:59 user nova-compute[82850]: STATIC:
Apr 12 07:47:59 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:47:59 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:47:59 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:47:59 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0
Apr 12 07:47:59 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:47:59 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:47:59 user nova-compute[82850]: FIRMWARE:
Apr 12 07:47:59 user nova-compute[82850]: No targets found.
Apr 12 07:47:59 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:47:59 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:47:59 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55391e04-9db7-4a01-9039-334f972d10c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:47:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a99ca-e6a3-4c5f-84b8-23cd19996950]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:00 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:48:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:00 user nova-compute[82850]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 (non-flash)
Apr 12 07:48:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194eca85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9003cf9-f6fb-4354-9ccb-2c9dee142452]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8ad95-d8b7-4533-a289-a89368a2c88f]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f890fb3c-7015-49ce-84ff-3327cf2e8323]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5b907-6a80-4fea-92ca-243c7cba2db6]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_edcd96d2', '/dev/disk/by-id/scsi-1SCST_BIOedcd96d2-7bd7ce3b2b79063d', '/dev/disk/by-id/scsi-23762643763653362') {{(pid=93535) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 07:48:00 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_edcd96d2
Apr 12 07:48:00 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOedcd96d2-7bd7ce3b2b79063d
Apr 12 07:48:00 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23762643763653362
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485f8bc-86c4-4332-bba3-cbea2887ece6]: (4, None) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b240f2df-15bc-4463-9a13-a081816b7b6e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c31a6-555d-4fc5-a2f8-8c7bc2f0b475]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260]
Apr 12 07:48:00 user nova-compute[82850]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa4ec2-0721-4589-9745-03f284555df0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf9207-865f-4a49-97e9-6b107cf78eb0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (420ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:48:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Deleting instance files /opt/stack/data/nova/instances/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5_del
Apr 12 07:48:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Deletion of /opt/stack/data/nova/instances/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5_del complete
Apr 12 07:48:00 user nova-compute[82850]: INFO nova.compute.manager [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 12 07:48:00 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:00 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:00 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Took 0.58 seconds to deallocate network for instance.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:01 user nova-compute[82850]: WARNING nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state building and task_state spawning.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-unplugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] No waiting events found dispatching network-vif-unplugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-unplugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Acquiring lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] No waiting events found dispatching network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:01 user nova-compute[82850]: WARNING nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received unexpected event network-vif-plugged-4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance with vm_state active and task_state deleting.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Received event network-vif-deleted-4b7609bc-36a3-40bc-a911-644f8b0d1766 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285681.209566, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Resumed (Lifecycle Event)
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance spawned successfully.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285681.2136536, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Started (Lifecycle Event)
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Took 7.19 seconds to build instance.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.295s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:01 user nova-compute[82850]: INFO nova.compute.manager [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Took 0.98 seconds to detach 1 volumes for instance.
Apr 12 07:48:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Deleting volume: 98aa4ec2-0721-4589-9745-03f284555df0 {{(pid=82850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:02 user nova-compute[82850]: INFO nova.compute.manager [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Terminating instance
Apr 12 07:48:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:02 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG nova.objects.instance [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'flavor' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.823s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:03 user nova-compute[82850]: INFO nova.compute.manager [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attaching volume 894167f3-141a-4eb7-80a6-60d5af7aada7 to /dev/vdb
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-unplugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] No waiting events found dispatching network-vif-unplugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-unplugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.utils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Instance destroyed successfully.
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lazy-loading 'resources' on Instance uuid e21b1323-aafd-4989-92c0-3ba5b45ba2bc {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593219528',display_name='tempest-ServersNegativeTestJSON-server-593219528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593219528',id=2,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1ea22b656f42ab9e8d117b0ff11b3a',ramdisk_id='',reservation_id='r-osw7omys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1126238824',owner_user_name='tempest-ServersNegativeTestJSON-1126238824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:39:39Z,user_data=None,user_id='4b61df1643964059b70eba466af4b6db',uuid=e21b1323-aafd-4989-92c0-3ba5b45ba2bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converting VIF {"id": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "address": "fa:16:3e:30:03:69", "network": {"id": "44ded1bd-af51-4bee-bb78-604e95e530cf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-944517350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1ea22b656f42ab9e8d117b0ff11b3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd739ef84-c0", "ovs_interfaceid": "d739ef84-c04b-4cbc-b836-4bf88483d1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_vif [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cb65a6-a4aa-46b0-b51a-c52b2439d11c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd739ef84-c0, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:48:03 user nova-compute[82850]: INFO os_vif [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:03:69,bridge_name='br-int',has_traffic_filtering=True,id=d739ef84-c04b-4cbc-b836-4bf88483d1a4,network=Network(44ded1bd-af51-4bee-bb78-604e95e530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd739ef84-c0')
Apr 12 07:48:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Deleting instance files /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc_del
Apr 12 07:48:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Deletion of /opt/stack/data/nova/instances/e21b1323-aafd-4989-92c0-3ba5b45ba2bc_del complete
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79b82d-799e-410a-9f88-6ce6d1cc6ea8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a3c1b-ac12-4484-91d4-7db2f59cf46f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8307eed-1369-40cb-8d97-02a54e3626f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:03 user nova-compute[82850]: INFO nova.compute.manager [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Took 0.81 seconds to destroy the instance on the hypervisor.
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:03 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:48:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[353f287e-5ec4-4842-9a62-a40cb7c004db]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG os_brick.utils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:03 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating existing volume attachment record: 10659350-cb30-47dd-b1d0-3d23afab9887 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:04 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Took 0.68 seconds to deallocate network for instance.
Apr 12 07:48:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:04 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Deleted allocations for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc
Apr 12 07:48:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:05 user nova-compute[82850]: DEBUG nova.compute.manager [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Acquiring lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Lock "e21b1323-aafd-4989-92c0-3ba5b45ba2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:05 user nova-compute[82850]: DEBUG nova.compute.manager [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] No waiting events found dispatching network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:05 user nova-compute[82850]: WARNING nova.compute.manager [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received unexpected event network-vif-plugged-d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance with vm_state deleted and task_state None.
Apr 12 07:48:05 user nova-compute[82850]: DEBUG nova.compute.manager [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Received event network-vif-deleted-d739ef84-c04b-4cbc-b836-4bf88483d1a4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:48:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:07 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:48:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96bbe81-8681-4d91-8d38-3339f5ee914d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:48:08 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c595cf5-2445-47a4-b1ac-22070a854da0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9408b202-0a67-443f-8477-38bc773d326e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ec263-ecb9-410a-84e6-674f1de3f4ca]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[64965d74-b84b-4504-93e0-1976f3a10a2e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHQspbel'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3279277-5a4d-48b1-896c-7eb486ee6a5c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae14267-4902-4e30-bd54-0d27696e04bd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[da492ee5-3576-4060-8663-57abd0cfa4c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:48:08 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592bc16-4af7-4cc7-a8c5-2ec00af158d3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf056577-1968-46a7-a2e1-4d75b35b57cb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22822f-488d-4cad-bd18-1870f414e758]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.objects.instance [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'flavor' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:48:09 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:48:09 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:48:09 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:48:09 user nova-compute[82850]:   <serial>894167f3-141a-4eb7-80a6-60d5af7aada7</serial>
Apr 12 07:48:09 user nova-compute[82850]: </disk>
Apr 12 07:48:09 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:d5:f3:b1, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:48:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.884s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Stashing vm_state: active {{(pid=82850) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 07:48:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_requests' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:48:13 user nova-compute[82850]: INFO nova.compute.claims [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Claim successful on node user
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:13 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating resource usage from migration d5339f06-d7d3-49d4-a585-a78bf7a1c605
Apr 12 07:48:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.543s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:13 user nova-compute[82850]: INFO nova.compute.manager [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Migrating
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:13 user nova-compute[82850]: INFO nova.compute.rpcapi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Starting migrate_disk_and_power_off {{(pid=82850) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:14 user nova-compute[82850]: WARNING nova.compute.manager [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state resize_migrating.
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285679.8489485, 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:14 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] VM Stopped (Lifecycle Event)
Apr 12 07:48:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-54643340-4c20-42d4-96ee-e1c400f0829f None None] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance destroyed successfully.
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24db70b-54, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:48:15 user nova-compute[82850]: INFO os_vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:15 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ac154-2de8-48f3-89d2-49f6972f9e87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:48:15 user nova-compute[82850]: No targets found.
Apr 12 07:48:15 user nova-compute[82850]: iSNS:
Apr 12 07:48:15 user nova-compute[82850]: No targets found.
Apr 12 07:48:15 user nova-compute[82850]: STATIC:
Apr 12 07:48:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:48:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:15 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:48:15 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:15 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:15 user nova-compute[82850]: FIRMWARE:
Apr 12 07:48:15 user nova-compute[82850]: No targets found.
Apr 12 07:48:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:48:15 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:48:15 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6e5d7a-c021-417f-84ff-4e6e39784f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66c99c-0f22-42b3-9e2e-e9e0a626cbab]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:15 user nova-compute[82850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:15 user nova-compute[82850]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c1bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb6274-7db3-4b37-ba09-b19c4b13a3c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[19077cdd-47fb-4960-8d4c-abc35ba5db94]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6936bdc1-7c80-4277-9df8-07b99a2c42f5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7a052-ee9f-4f13-8b0c-a1d80dbccf89]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46d018e-8ce5-41c9-8d5d-b12778c7f65a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06746506-8cb4-4663-9635-ef1ed72fe0c5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:48:15 user nova-compute[82850]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c44579-37d0-493e-b55e-acce07a51cbe]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (298ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:48:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_resize/disk /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_resize/disk /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk" returned: 0 in 0.387s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_resize/disk.info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_resize/disk.info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk.info" returned: 0 in 0.031s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:16 user nova-compute[82850]: WARNING nova.compute.manager [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state resize_migrating.
Apr 12 07:48:17 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Port d24db70b-543b-4549-8c33-b8276a776c3d binding to destination host user is already ACTIVE {{(pid=82850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:17 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285683.1962256, e21b1323-aafd-4989-92c0-3ba5b45ba2bc => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:18 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] VM Stopped (Lifecycle Event)
Apr 12 07:48:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9f10a351-5f77-4131-ab2e-21c2c5b3ae53 None None] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.utils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65ca55e-e81c-4084-acfc-1012afadb472]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adc439c-f824-4684-ab2d-875f6fc3f3f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427a0e3-81a0-4685-b15e-6ff75f79c0a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8f6c0-9e75-4c87-b9f9-4edf4c46be47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:18 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a92c25-a20f-4995-ac97-67fdc80ac987]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG os_brick.utils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:48:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=26.273193359375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Applying migration context for instance 3b7424e4-52aa-4330-a748-006240372716 as it has an incoming, in-progress migration d5339f06-d7d3-49d4-a585-a78bf7a1c605. Migration status is post-migrating {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 07:48:23 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating resource usage from migration d5339f06-d7d3-49d4-a585-a78bf7a1c605
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 00258d37-14c7-4657-b9c4-c636c93811ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Migration d5339f06-d7d3-49d4-a585-a78bf7a1c605 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Starting finish_migration {{(pid=82850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:48:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating image(s)
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:48:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Cannot resize image /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Ensure instance console log exists: /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start _get_guest_xml network_info=[{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b7424e4-52aa-4330-a748-006240372716', 'attached_at': '2023-04-12T07:48:24.000000', 'detached_at': '', 'volume_id': '894167f3-141a-4eb7-80a6-60d5af7aada7', 'serial': '894167f3-141a-4eb7-80a6-60d5af7aada7'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '2d5d0fde-dc67-4aa7-b980-8939320fbb97', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:48:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:24 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:24 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:24 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f11593-0ed6-43a8-91f6-707b6e5f631f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:48:24 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9205568-1091-4524-a20a-1792935082cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc3167-0f16-4f50-9911-fcb539b57a1c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1817746-574a-4324-8410-c0ca499eb6e0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb82b5c-64e7-4921-8b7d-e6be387d1391]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHQspbel'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ff11a-df71-4d5f-b29b-d72e7882bc75]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ebc72a-ab0b-42ad-a207-67445eadd218]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef30c3e-2fcd-4e7f-b9e4-abf59b16aa90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:48:24 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[298796c5-a062-4de7-a393-d76607667ff7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e1aa7-28a3-4fa1-859b-759603a2d52d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:24 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0083956e-da4a-49a3-926e-5d19691d4dcb]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:48:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:48:25 user nova-compute[82850]:   <uuid>3b7424e4-52aa-4330-a748-006240372716</uuid>
Apr 12 07:48:25 user nova-compute[82850]:   <name>instance-00000004</name>
Apr 12 07:48:25 user nova-compute[82850]:   <memory>196608</memory>
Apr 12 07:48:25 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:48:25 user nova-compute[82850]:   <metadata>
Apr 12 07:48:25 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:48:25 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-926530387</nova:name>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:48:24</nova:creationTime>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:flavor name="m1.micro">
Apr 12 07:48:25 user nova-compute[82850]:         <nova:memory>192</nova:memory>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:48:25 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:owner>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:48:25 user nova-compute[82850]:       </nova:owner>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:48:25 user nova-compute[82850]:       <nova:ports>
Apr 12 07:48:25 user nova-compute[82850]:         <nova:port uuid="d24db70b-543b-4549-8c33-b8276a776c3d">
Apr 12 07:48:25 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:48:25 user nova-compute[82850]:         </nova:port>
Apr 12 07:48:25 user nova-compute[82850]:       </nova:ports>
Apr 12 07:48:25 user nova-compute[82850]:     </nova:instance>
Apr 12 07:48:25 user nova-compute[82850]:   </metadata>
Apr 12 07:48:25 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:48:25 user nova-compute[82850]:     <system>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="serial">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="uuid">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:48:25 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:48:25 user nova-compute[82850]:     </system>
Apr 12 07:48:25 user nova-compute[82850]:   </sysinfo>
Apr 12 07:48:25 user nova-compute[82850]:   <os>
Apr 12 07:48:25 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:48:25 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:48:25 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:48:25 user nova-compute[82850]:   </os>
Apr 12 07:48:25 user nova-compute[82850]:   <features>
Apr 12 07:48:25 user nova-compute[82850]:     <acpi/>
Apr 12 07:48:25 user nova-compute[82850]:     <apic/>
Apr 12 07:48:25 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:48:25 user nova-compute[82850]:   </features>
Apr 12 07:48:25 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:48:25 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:48:25 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:48:25 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:48:25 user nova-compute[82850]:   </clock>
Apr 12 07:48:25 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:48:25 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:48:25 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:48:25 user nova-compute[82850]:   </cpu>
Apr 12 07:48:25 user nova-compute[82850]:   <devices>
Apr 12 07:48:25 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:48:25 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:48:25 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk"/>
Apr 12 07:48:25 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:48:25 user nova-compute[82850]:     </disk>
Apr 12 07:48:25 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:48:25 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:48:25 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:48:25 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:48:25 user nova-compute[82850]:       <serial>894167f3-141a-4eb7-80a6-60d5af7aada7</serial>
Apr 12 07:48:25 user nova-compute[82850]:     </disk>
Apr 12 07:48:25 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:48:25 user nova-compute[82850]:       <mac address="fa:16:3e:d5:f3:b1"/>
Apr 12 07:48:25 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:48:25 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:48:25 user nova-compute[82850]:       <target dev="tapd24db70b-54"/>
Apr 12 07:48:25 user nova-compute[82850]:     </interface>
Apr 12 07:48:25 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:48:25 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log" append="off"/>
Apr 12 07:48:25 user nova-compute[82850]:     </serial>
Apr 12 07:48:25 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:48:25 user nova-compute[82850]:     <video>
Apr 12 07:48:25 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:48:25 user nova-compute[82850]:     </video>
Apr 12 07:48:25 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:48:25 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:48:25 user nova-compute[82850]:     </rng>
Apr 12 07:48:25 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:48:25 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:48:25 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:48:25 user nova-compute[82850]:     </memballoon>
Apr 12 07:48:25 user nova-compute[82850]:   </devices>
Apr 12 07:48:25 user nova-compute[82850]: </domain>
Apr 12 07:48:25 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:d5:f3:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG os_vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24db70b-54, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd24db70b-54, col_values=(('external_ids', {'iface-id': 'd24db70b-543b-4549-8c33-b8276a776c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f3:b1', 'vm-uuid': '3b7424e4-52aa-4330-a748-006240372716'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:25 user nova-compute[82850]: INFO os_vif [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:d5:f3:b1, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:48:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:27 user nova-compute[82850]: WARNING nova.compute.manager [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state resize_finish.
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 3b7424e4-52aa-4330-a748-006240372716 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285709.151565, 3b7424e4-52aa-4330-a748-006240372716 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:29 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Resumed (Lifecycle Event)
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:48:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance running successfully.
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Failed to set time: agent not configured {{(pid=82850) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] finish_migration finished successfully. {{(pid=82850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:29 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285709.1519115, 3b7424e4-52aa-4330-a748-006240372716 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:29 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Started (Lifecycle Event)
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:29 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:29 user nova-compute[82850]: WARNING nova.compute.manager [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state resized and task_state None.
Apr 12 07:48:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:48:41 user nova-compute[82850]: INFO nova.compute.claims [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Claim successful on node user
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.objects.instance [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:41 user nova-compute[82850]: INFO nova.compute.manager [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attaching volume 78addffa-1acb-411d-9bc2-6e61bac1e13b to /dev/vdb
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG os_brick.utils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a0d9a3-c0ba-4b8f-a1e2-b8e975b02085]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed291755-4854-4e9e-a7d9-35bd063d4943]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c8bbe5-7e72-444b-b179-e153927e057d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a52cea-2ca4-432a-97a1-c1edb8f2d60c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:48:42 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9ac310-66bc-41d0-89a1-d4175e419354]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG os_brick.utils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating existing volume attachment record: 09adc450-74ff-4739-af6f-eb859d8a93c2 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:48:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.policy [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66018ab9b9c54fc593b4f872f6ef4c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853e85be61864e66b0b8e8be4e3059fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:48:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Creating image(s)
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "/opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "/opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.156s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk 1073741824" returned: 0 in 0.067s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:42 user nova-compute[82850]: INFO nova.compute.manager [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] instance snapshotting
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Cannot resize image /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lazy-loading 'migration_context' on Instance uuid bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Ensure instance console log exists: /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Beginning live snapshot process
Apr 12 07:48:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Successfully created port: 43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.185s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa.delta 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa.delta 1073741824" returned: 0 in 0.057s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 07:48:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Successfully updated port: 43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquired lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-changed-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Refreshing instance network info cache due to event network-changed-43a66fc3-42b3-49e6-bbb8-514842e2200f. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Acquiring lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:48:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Updating instance_info_cache with network_info: [{"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Releasing lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Instance network_info: |[{"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Acquired lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Refreshing network info cache for port 43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Start _get_guest_xml network_info=[{"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:48:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-35389323',display_name='tempest-VolumesNegativeTest-instance-35389323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-35389323',id=23,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853e85be61864e66b0b8e8be4e3059fa',ramdisk_id='',reservation_id='r-pzad5ftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-653023601',owner_user_name='tempest-VolumesNegativeTest-653023601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:48:42Z,user_data=None,user_id='66018ab9b9c54fc593b4f872f6ef4c9a',uuid=bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converting VIF {"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lazy-loading 'pci_devices' on Instance uuid bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:48:44 user nova-compute[82850]:   <uuid>bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16</uuid>
Apr 12 07:48:44 user nova-compute[82850]:   <name>instance-00000017</name>
Apr 12 07:48:44 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:48:44 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:48:44 user nova-compute[82850]:   <metadata>
Apr 12 07:48:44 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:48:44 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:name>tempest-VolumesNegativeTest-instance-35389323</nova:name>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:48:44</nova:creationTime>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:48:44 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:48:44 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:owner>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:user uuid="66018ab9b9c54fc593b4f872f6ef4c9a">tempest-VolumesNegativeTest-653023601-project-member</nova:user>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:project uuid="853e85be61864e66b0b8e8be4e3059fa">tempest-VolumesNegativeTest-653023601</nova:project>
Apr 12 07:48:44 user nova-compute[82850]:       </nova:owner>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:48:44 user nova-compute[82850]:       <nova:ports>
Apr 12 07:48:44 user nova-compute[82850]:         <nova:port uuid="43a66fc3-42b3-49e6-bbb8-514842e2200f">
Apr 12 07:48:44 user nova-compute[82850]:           <nova:ip type="fixed" address="192.168.233.168" ipVersion="4"/>
Apr 12 07:48:44 user nova-compute[82850]:         </nova:port>
Apr 12 07:48:44 user nova-compute[82850]:       </nova:ports>
Apr 12 07:48:44 user nova-compute[82850]:     </nova:instance>
Apr 12 07:48:44 user nova-compute[82850]:   </metadata>
Apr 12 07:48:44 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:48:44 user nova-compute[82850]:     <system>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="serial">bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16</entry>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="uuid">bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16</entry>
Apr 12 07:48:44 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:48:44 user nova-compute[82850]:     </system>
Apr 12 07:48:44 user nova-compute[82850]:   </sysinfo>
Apr 12 07:48:44 user nova-compute[82850]:   <os>
Apr 12 07:48:44 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:48:44 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:48:44 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:48:44 user nova-compute[82850]:   </os>
Apr 12 07:48:44 user nova-compute[82850]:   <features>
Apr 12 07:48:44 user nova-compute[82850]:     <acpi/>
Apr 12 07:48:44 user nova-compute[82850]:     <apic/>
Apr 12 07:48:44 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:48:44 user nova-compute[82850]:   </features>
Apr 12 07:48:44 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:48:44 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:48:44 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:48:44 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:48:44 user nova-compute[82850]:   </clock>
Apr 12 07:48:44 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:48:44 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:48:44 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:48:44 user nova-compute[82850]:   </cpu>
Apr 12 07:48:44 user nova-compute[82850]:   <devices>
Apr 12 07:48:44 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:48:44 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:48:44 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk"/>
Apr 12 07:48:44 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:48:44 user nova-compute[82850]:     </disk>
Apr 12 07:48:44 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:48:44 user nova-compute[82850]:       <mac address="fa:16:3e:b7:20:2d"/>
Apr 12 07:48:44 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:48:44 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:48:44 user nova-compute[82850]:       <target dev="tap43a66fc3-42"/>
Apr 12 07:48:44 user nova-compute[82850]:     </interface>
Apr 12 07:48:44 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:48:44 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/console.log" append="off"/>
Apr 12 07:48:44 user nova-compute[82850]:     </serial>
Apr 12 07:48:44 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:48:44 user nova-compute[82850]:     <video>
Apr 12 07:48:44 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:48:44 user nova-compute[82850]:     </video>
Apr 12 07:48:44 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:48:44 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:48:44 user nova-compute[82850]:     </rng>
Apr 12 07:48:44 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:48:44 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:48:44 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:48:44 user nova-compute[82850]:     </memballoon>
Apr 12 07:48:44 user nova-compute[82850]:   </devices>
Apr 12 07:48:44 user nova-compute[82850]: </domain>
Apr 12 07:48:44 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-35389323',display_name='tempest-VolumesNegativeTest-instance-35389323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-35389323',id=23,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853e85be61864e66b0b8e8be4e3059fa',ramdisk_id='',reservation_id='r-pzad5ftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-653023601',owner_user_name='tempest-VolumesNegativeTest-653023601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:48:42Z,user_data=None,user_id='66018ab9b9c54fc593b4f872f6ef4c9a',uuid=bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converting VIF {"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG os_vif [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a66fc3-42, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43a66fc3-42, col_values=(('external_ids', {'iface-id': '43a66fc3-42b3-49e6-bbb8-514842e2200f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:20:2d', 'vm-uuid': 'bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:44 user nova-compute[82850]: INFO os_vif [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42')
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] No VIF found with MAC fa:16:3e:b7:20:2d, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Updated VIF entry in instance network info cache for port 43a66fc3-42b3-49e6-bbb8-514842e2200f. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG nova.network.neutron [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Updating instance_info_cache with network_info: [{"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Releasing lock "refresh_cache-bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:48:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 07:48:45 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa.delta /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa.delta /opt/stack/data/nova/instances/snapshots/tmp2i2krskx/edd8a402c6424e59b60f83c020ac0bfa" returned: 0 in 0.382s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Snapshot extracted, beginning image upload
Apr 12 07:48:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] No waiting events found dispatching network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:46 user nova-compute[82850]: WARNING nova.compute.manager [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received unexpected event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f for instance with vm_state building and task_state spawning.
Apr 12 07:48:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYZcUqDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:46 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:46 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:46 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45772bb-f2a4-41cf-9c01-fc9c136002e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:48:46 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1978fc61-2326-4e1c-bcd3-d19f38e960ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b] added
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c702ba91-ae14-44b1-a9af-9ab0774909ec]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c4a7e3-6587-4d35-b9a8-48de02ae7469]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYZcUqDd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYZcUqDd" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[33806bc3-2e55-4c23-abb7-25492172abb1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rYZcUqDd'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a655f-cece-4784-94b9-b7d57496f757]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f38805-4eae-4d02-b784-c31328fd7177]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a6a43-6ed9-4f2a-8bd1-8543203c5345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260]
Apr 12 07:48:46 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a79e1c-b1c3-4632-9a9a-535ee97057c4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d91d761-f291-4cbd-bd03-02b876f83159]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:46 user nova-compute[82850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)
Apr 12 07:48:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[168d5f13-69f1-435e-b084-573895dc276d]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:47 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285728.0011175, bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] VM Resumed (Lifecycle Event)
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Instance spawned successfully.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYZcUqDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23737663639616230', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737663639616230', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285728.0024395, bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] VM Started (Lifecycle Event)
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:48:48 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:48:48 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:48:48 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:48:48 user nova-compute[82850]:   <serial>78addffa-1acb-411d-9bc2-6e61bac1e13b</serial>
Apr 12 07:48:48 user nova-compute[82850]: </disk>
Apr 12 07:48:48 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] No waiting events found dispatching network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:48 user nova-compute[82850]: WARNING nova.compute.manager [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received unexpected event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f for instance with vm_state building and task_state spawning.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Took 5.98 seconds to spawn the instance on the hypervisor.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Took 6.87 seconds to build instance.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.975s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Snapshot image upload complete
Apr 12 07:48:48 user nova-compute[82850]: INFO nova.compute.manager [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Took 5.49 seconds to snapshot the instance on the hypervisor.
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No VIF found with MAC fa:16:3e:04:2c:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:48:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.837s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:50 user nova-compute[82850]: INFO nova.compute.manager [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Detaching volume 78addffa-1acb-411d-9bc2-6e61bac1e13b
Apr 12 07:48:50 user nova-compute[82850]: INFO nova.virt.block_device [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attempting to driver detach volume 78addffa-1acb-411d-9bc2-6e61bac1e13b from mountpoint /dev/vdb
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Attempting to detach device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:48:50 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:48:50 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:48:50 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:48:50 user nova-compute[82850]:   <serial>78addffa-1acb-411d-9bc2-6e61bac1e13b</serial>
Apr 12 07:48:50 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:48:50 user nova-compute[82850]: </disk>
Apr 12 07:48:50 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:48:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config.
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:48:50 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:48:50 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:48:50 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:48:50 user nova-compute[82850]:   <serial>78addffa-1acb-411d-9bc2-6e61bac1e13b</serial>
Apr 12 07:48:50 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:48:50 user nova-compute[82850]: </disk>
Apr 12 07:48:50 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285730.657209, 31672149-0612-4e15-aacd-e37c7536109c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:48:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config.
Apr 12 07:48:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYZcUqDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:50 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0fb14-98ca-484a-9b91-4963620bd0d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:48:50 user nova-compute[82850]: No targets found.
Apr 12 07:48:50 user nova-compute[82850]: iSNS:
Apr 12 07:48:50 user nova-compute[82850]: No targets found.
Apr 12 07:48:50 user nova-compute[82850]: STATIC:
Apr 12 07:48:50 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:48:50 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:50 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:50 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:48:50 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:50 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:50 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b
Apr 12 07:48:50 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:50 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:50 user nova-compute[82850]: FIRMWARE:
Apr 12 07:48:50 user nova-compute[82850]: No targets found.
Apr 12 07:48:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:48:50 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:48:50 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[950435d2-69e3-4fb4-9b20-4e5ef7105368]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b5e1f-b1be-48be-9247-e48ecc7d9f16]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:50 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:50 user nova-compute[82850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)
Apr 12 07:48:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:50 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:50 user nova-compute[82850]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b (non-flash)
Apr 12 07:48:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c1af5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d463ade7-1e65-4755-9794-db4bd3298730]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b2f981-c0bc-4c16-8c6d-2ee4c90f06f2]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38a5b1-cc4d-4af3-b687-6348e1d74184]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d742fc8-fa92-41fe-9f8b-5a0250aabca6]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9abef9-c2f7-4542-8552-a25faa7b6243]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e8940-7769-4665-8353-659c2219d99e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260]
Apr 12 07:48:50 user nova-compute[82850]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:50 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78addffa-1acb-411d-9bc2-6e61bac1e13b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6410f5e6-9aa3-45ea-b90c-0d97ebfd78a4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== disconnect_volume: return (332ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:51 user nova-compute[82850]: INFO nova.compute.manager [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Terminating instance
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.objects.instance [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-unplugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] No waiting events found dispatching network-vif-unplugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-unplugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:48:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Instance destroyed successfully.
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 487f2b38-0f8d-40c1-9c10-32caf60a61a2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1614827921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1614827921',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-5b5oxx5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:29Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=487f2b38-0f8d-40c1-9c10-32caf60a61a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "address": "fa:16:3e:25:59:48", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93af7856-3e", "ovs_interfaceid": "93af7856-3e09-423a-a240-2e00ddcf6ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_vif [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93af7856-3e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:52 user nova-compute[82850]: INFO os_vif [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:59:48,bridge_name='br-int',has_traffic_filtering=True,id=93af7856-3e09-423a-a240-2e00ddcf6ce0,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93af7856-3e')
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyAkjEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:48:52 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecebaf1-3226-4ab0-addf-033b33e7678f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:48:52 user nova-compute[82850]: No targets found.
Apr 12 07:48:52 user nova-compute[82850]: iSNS:
Apr 12 07:48:52 user nova-compute[82850]: No targets found.
Apr 12 07:48:52 user nova-compute[82850]: STATIC:
Apr 12 07:48:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:48:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72
Apr 12 07:48:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:48:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:48:52 user nova-compute[82850]: FIRMWARE:
Apr 12 07:48:52 user nova-compute[82850]: No targets found.
Apr 12 07:48:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:48:52 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:48:52 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e34d1-4b34-458f-894b-124abaff4ad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a68ce8-707f-4116-9ab7-ee63e942f22a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:52 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 (non-flash)
Apr 12 07:48:52 user nova-compute[82850]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:48:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0f6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72'): ({'sdh'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdh {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7171762-d1a9-4aac-a786-85869ccf6c34]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a1b8f6-b763-4651-a3d5-64c659ec119d]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdh {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d494d81f-9743-48fd-8872-677c455e97ae]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd15fdf-65f6-4cbd-8009-d7deea6ea54c]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdh have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_30b6debf', '/dev/disk/by-id/scsi-26133623761366561', '/dev/disk/by-id/scsi-1SCST_BIO30b6debf-a3b7a6ea19b00340') {{(pid=93535) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaf0f34-b36c-47f6-8c01-d832bcfa8852]: (4, None) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdbe9fa-d8f0-46c4-875c-ab7c6d245756]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c3b7d6-0d2e-4ba3-a1cd-fb26722043ec]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260]
Apr 12 07:48:52 user nova-compute[82850]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72, portal: 172.16.0.220,3260] successful.
Apr 12 07:48:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50d3d191-8644-4001-b806-929d0e869a72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d79dd21-f7fb-4ef7-a49e-ca5ba852508c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (324ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:48:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Deleting instance files /opt/stack/data/nova/instances/487f2b38-0f8d-40c1-9c10-32caf60a61a2_del
Apr 12 07:48:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Deletion of /opt/stack/data/nova/instances/487f2b38-0f8d-40c1-9c10-32caf60a61a2_del complete
Apr 12 07:48:52 user nova-compute[82850]: INFO nova.compute.manager [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 07:48:52 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:48:52 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:48:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-deleted-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:53 user nova-compute[82850]: INFO nova.compute.manager [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Neutron deleted interface 93af7856-3e09-423a-a240-2e00ddcf6ce0; detaching it from the instance and deleting it from the info cache
Apr 12 07:48:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:53 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:53 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Took 0.49 seconds to deallocate network for instance.
Apr 12 07:48:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Detach interface failed, port_id=93af7856-3e09-423a-a240-2e00ddcf6ce0, reason: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Acquiring lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] No waiting events found dispatching network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:54 user nova-compute[82850]: WARNING nova.compute.manager [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Received unexpected event network-vif-plugged-93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance with vm_state active and task_state deleting.
Apr 12 07:48:54 user nova-compute[82850]: INFO nova.compute.manager [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Took 0.75 seconds to detach 1 volumes for instance.
Apr 12 07:48:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Deleting volume: 50d3d191-8644-4001-b806-929d0e869a72 {{(pid=82850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:54 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2
Apr 12 07:48:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "487f2b38-0f8d-40c1-9c10-32caf60a61a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.136s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:55 user nova-compute[82850]: INFO nova.compute.manager [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Terminating instance
Apr 12 07:48:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-unplugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:48:56 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Instance destroyed successfully.
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'resources' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1794309151',display_name='tempest-AttachVolumeTestJSON-server-1794309151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1794309151',id=6,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg==',key_name='tempest-keypair-1283331574',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-nhbn65i2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=f79ca8ec-41b5-4b60-882f-d74d906fb8e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "address": "fa:16:3e:b7:ec:08", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ca8897-71", "ovs_interfaceid": "40ca8897-7180-4ef1-91f2-29b18afbcc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG os_vif [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40ca8897-71, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:48:56 user nova-compute[82850]: INFO os_vif [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ec:08,bridge_name='br-int',has_traffic_filtering=True,id=40ca8897-7180-4ef1-91f2-29b18afbcc25,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ca8897-71')
Apr 12 07:48:56 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Deleting instance files /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6_del
Apr 12 07:48:56 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Deletion of /opt/stack/data/nova/instances/f79ca8ec-41b5-4b60-882f-d74d906fb8e6_del complete
Apr 12 07:48:56 user nova-compute[82850]: INFO nova.compute.manager [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 07:48:56 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:48:56 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:48:57 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Took 0.82 seconds to deallocate network for instance.
Apr 12 07:48:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-deleted-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:48:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:58 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Deleted allocations for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6
Apr 12 07:48:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:48:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Acquiring lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:48:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:48:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Lock "f79ca8ec-41b5-4b60-882f-d74d906fb8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:48:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] No waiting events found dispatching network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:48:58 user nova-compute[82850]: WARNING nova.compute.manager [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Received unexpected event network-vif-plugged-40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance with vm_state deleted and task_state None.
Apr 12 07:49:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:07 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285732.4129636, 487f2b38-0f8d-40c1-9c10-32caf60a61a2 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:49:07 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] VM Stopped (Lifecycle Event)
Apr 12 07:49:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b7650cb4-91bd-4762-9523-55077d50bbb0 None None] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:49:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:11 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285736.6904342, f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:49:11 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] VM Stopped (Lifecycle Event)
Apr 12 07:49:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2e526ec2-63d7-4b47-b8ff-d046689cdeaf None None] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:49:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:19 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:49:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Ignoring supplied device name: /dev/vdb
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:23 user nova-compute[82850]: INFO nova.compute.manager [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Attaching volume 6eca1c24-192a-426f-ba99-a899f2e68f90 to /dev/vdb
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.utils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee9bda-0a59-4547-ba61-16a6a1b5ae5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47be3a4-e37e-4778-9d5c-87eb15fc244b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590be50-e60a-4059-b0cd-53c0c5fa712e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e85be8-ad11-4085-947d-871a0b2ab9e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:23 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:49:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666a481-aa20-47ab-bdbd-3b01088072d4]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG os_brick.utils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Updating existing volume attachment record: 98675755-2522-46e6-b4fa-222065dc4156 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:49:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:49:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=26.215484619140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Applying migration context for instance 3b7424e4-52aa-4330-a748-006240372716 as it has an incoming, in-progress migration d5339f06-d7d3-49d4-a585-a78bf7a1c605. Migration status is finished {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 07:49:24 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating resource usage from migration d5339f06-d7d3-49d4-a585-a78bf7a1c605
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 00258d37-14c7-4657-b9c4-c636c93811ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Migration d5339f06-d7d3-49d4-a585-a78bf7a1c605 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 40c8d6d7-d840-4417-b897-92ff8258d984 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:49:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.613s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:49:25 user nova-compute[82850]: INFO nova.compute.claims [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Claim successful on node user
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.policy [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:49:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Creating image(s)
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.part --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG nova.virt.images [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 47938fc9-ecf8-4c1a-8f19-67593f191ec6 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.part /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.part /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.converted" returned: 0 in 0.250s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Successfully created port: 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.895s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff,backing_fmt=raw /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff,backing_fmt=raw /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk 1073741824" returned: 0 in 0.052s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "d33bce93a0051fc0594f54cadebe701cac7f69ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Cannot resize image /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'migration_context' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Ensure instance console log exists: /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Successfully updated port: 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing instance network info cache due to event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance network_info: |[{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start _get_guest_xml network_info=[{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:49:21Z,direct_url=<?>,disk_format='qcow2',id=47938fc9-ecf8-4c1a-8f19-67593f191ec6,min_disk=0,min_ram=0,name='tempest-scenario-img--2068395831',owner='27f4f7b1930e48cb82f5f6010872e221',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:49:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '47938fc9-ecf8-4c1a-8f19-67593f191ec6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPGjhBWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:28 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:49:21Z,direct_url=<?>,disk_format='qcow2',id=47938fc9-ecf8-4c1a-8f19-67593f191ec6,min_disk=0,min_ram=0,name='tempest-scenario-img--2068395831',owner='27f4f7b1930e48cb82f5f6010872e221',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:49:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:26Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'pci_devices' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ddd13-7773-46da-bb8a-33a436526194]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:49:28 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:49:28 user nova-compute[82850]:   <uuid>40c8d6d7-d840-4417-b897-92ff8258d984</uuid>
Apr 12 07:49:28 user nova-compute[82850]:   <name>instance-00000018</name>
Apr 12 07:49:28 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:49:28 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:49:28 user nova-compute[82850]:   <metadata>
Apr 12 07:49:28 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:49:28 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:name>tempest-TestMinimumBasicScenario-server-381898933</nova:name>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:49:28</nova:creationTime>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:49:28 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:49:28 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:owner>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:user uuid="630f8381d3534fd3a1978fc0a931e8c0">tempest-TestMinimumBasicScenario-1759703879-project-member</nova:user>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:project uuid="27f4f7b1930e48cb82f5f6010872e221">tempest-TestMinimumBasicScenario-1759703879</nova:project>
Apr 12 07:49:28 user nova-compute[82850]:       </nova:owner>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:root type="image" uuid="47938fc9-ecf8-4c1a-8f19-67593f191ec6"/>
Apr 12 07:49:28 user nova-compute[82850]:       <nova:ports>
Apr 12 07:49:28 user nova-compute[82850]:         <nova:port uuid="8c395303-b043-4eef-a6ac-e567893e6de4">
Apr 12 07:49:28 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 07:49:28 user nova-compute[82850]:         </nova:port>
Apr 12 07:49:28 user nova-compute[82850]:       </nova:ports>
Apr 12 07:49:28 user nova-compute[82850]:     </nova:instance>
Apr 12 07:49:28 user nova-compute[82850]:   </metadata>
Apr 12 07:49:28 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:49:28 user nova-compute[82850]:     <system>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="serial">40c8d6d7-d840-4417-b897-92ff8258d984</entry>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="uuid">40c8d6d7-d840-4417-b897-92ff8258d984</entry>
Apr 12 07:49:28 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:49:28 user nova-compute[82850]:     </system>
Apr 12 07:49:28 user nova-compute[82850]:   </sysinfo>
Apr 12 07:49:28 user nova-compute[82850]:   <os>
Apr 12 07:49:28 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:49:28 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:49:28 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:49:28 user nova-compute[82850]:   </os>
Apr 12 07:49:28 user nova-compute[82850]:   <features>
Apr 12 07:49:28 user nova-compute[82850]:     <acpi/>
Apr 12 07:49:28 user nova-compute[82850]:     <apic/>
Apr 12 07:49:28 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:49:28 user nova-compute[82850]:   </features>
Apr 12 07:49:28 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:49:28 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:49:28 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:49:28 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:49:28 user nova-compute[82850]:   </clock>
Apr 12 07:49:28 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:49:28 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:49:28 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:49:28 user nova-compute[82850]:   </cpu>
Apr 12 07:49:28 user nova-compute[82850]:   <devices>
Apr 12 07:49:28 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:49:28 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:49:28 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk"/>
Apr 12 07:49:28 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:49:28 user nova-compute[82850]:     </disk>
Apr 12 07:49:28 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:49:28 user nova-compute[82850]:       <mac address="fa:16:3e:4d:b3:b8"/>
Apr 12 07:49:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:28 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:49:28 user nova-compute[82850]:       <target dev="tap8c395303-b0"/>
Apr 12 07:49:28 user nova-compute[82850]:     </interface>
Apr 12 07:49:28 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:49:28 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/console.log" append="off"/>
Apr 12 07:49:28 user nova-compute[82850]:     </serial>
Apr 12 07:49:28 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:49:28 user nova-compute[82850]:     <video>
Apr 12 07:49:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:28 user nova-compute[82850]:     </video>
Apr 12 07:49:28 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:49:28 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:49:28 user nova-compute[82850]:     </rng>
Apr 12 07:49:28 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:49:28 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:49:28 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:49:28 user nova-compute[82850]:     </memballoon>
Apr 12 07:49:28 user nova-compute[82850]:   </devices>
Apr 12 07:49:28 user nova-compute[82850]: </domain>
Apr 12 07:49:28 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:26Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_vif [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c395303-b0, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c395303-b0, col_values=(('external_ids', {'iface-id': '8c395303-b043-4eef-a6ac-e567893e6de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:b3:b8', 'vm-uuid': '40c8d6d7-d840-4417-b897-92ff8258d984'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2cad33-8d22-4545-9a75-35fdbb472ecb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90] added
Apr 12 07:49:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:28 user nova-compute[82850]: INFO os_vif [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0')
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f4ef6b-5f9a-4ab8-bea5-d0b773189e3b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36361f0d-d0bb-4986-b6c3-3e27b649f3ec]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPGjhBWL {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No VIF found with MAC fa:16:3e:4d:b3:b8, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPGjhBWL" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd03294-bc1c-4145-8df2-3fb64906c0ce]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPGjhBWL'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d0644-038f-4b3d-9389-4b9d32b68a2a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f773cf0-1e71-49ad-9980-dd1211778545]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updated VIF entry in instance network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --login" returned: 0 in 1.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84dc797-4f4a-4912-88a3-f54db3249cb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260]
Apr 12 07:49:29 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc84c47b-8fa5-48d0-af19-135be9e2e93a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5776a-a222-40e6-b51a-284245498df8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:29 user nova-compute[82850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)
Apr 12 07:49:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:29 user nova-compute[82850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)
Apr 12 07:49:29 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.321s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2c86c6-12c6-4d9a-bf7d-376c66a58d78]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPGjhBWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:30 user nova-compute[82850]: WARNING nova.compute.manager [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state building and task_state spawning.
Apr 12 07:49:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.351s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== connect_volume: return (2353ms) {'type': 'block', 'scsi_wwn': '26133663731366232', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663731366232', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:49:30 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:30 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:30 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:30 user nova-compute[82850]:   <serial>6eca1c24-192a-426f-ba99-a899f2e68f90</serial>
Apr 12 07:49:30 user nova-compute[82850]: </disk>
Apr 12 07:49:30 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:49:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No VIF found with MAC fa:16:3e:83:5b:56, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.972s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285772.0853772, 40c8d6d7-d840-4417-b897-92ff8258d984 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] VM Resumed (Lifecycle Event)
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance spawned successfully.
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285772.0867145, 40c8d6d7-d840-4417-b897-92ff8258d984 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] VM Started (Lifecycle Event)
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:32 user nova-compute[82850]: WARNING nova.compute.manager [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state building and task_state spawning.
Apr 12 07:49:32 user nova-compute[82850]: INFO nova.compute.manager [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Took 7.86 seconds to build instance.
Apr 12 07:49:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.454s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG nova.objects.instance [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:43 user nova-compute[82850]: INFO nova.compute.manager [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attaching volume 3538e8ac-5519-4d52-92fc-1e55d8abdefe to /dev/vdb
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.utils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d075cdb1-ee40-497a-ad5c-5bdd15c93330]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde48354-fd4c-435d-83b8-535baed1fd6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.213s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc6609d-0b0e-4eba-9f52-f65351c420ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c0c260-4ec5-45eb-a673-c7b78ee2c29b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:43 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:49:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bf844-9b32-42f1-a4b6-9035c9682e41]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG os_brick.utils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== get_connector_properties: return (335ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:43 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating existing volume attachment record: cdc53384-b655-4e01-a6f1-aae8fd5776ac {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing instance network info cache due to event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG nova.network.neutron [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:46 user nova-compute[82850]: INFO nova.compute.manager [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Detaching volume 6eca1c24-192a-426f-ba99-a899f2e68f90
Apr 12 07:49:46 user nova-compute[82850]: INFO nova.virt.block_device [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Attempting to driver detach volume 6eca1c24-192a-426f-ba99-a899f2e68f90 from mountpoint /dev/vdb
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:46 user nova-compute[82850]: INFO nova.compute.manager [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Attaching volume 845065d9-ece0-4d59-b500-cb1c3f40197f to /dev/vdb
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Attempting to detach device vdb from instance 00258d37-14c7-4657-b9c4-c636c93811ce from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:49:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:46 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:46 user nova-compute[82850]:   <serial>6eca1c24-192a-426f-ba99-a899f2e68f90</serial>
Apr 12 07:49:46 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:49:46 user nova-compute[82850]: </disk>
Apr 12 07:49:46 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:49:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully detached device vdb from instance 00258d37-14c7-4657-b9c4-c636c93811ce from the persistent domain config.
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00258d37-14c7-4657-b9c4-c636c93811ce from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:49:46 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:46 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:46 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:46 user nova-compute[82850]:   <serial>6eca1c24-192a-426f-ba99-a899f2e68f90</serial>
Apr 12 07:49:46 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:49:46 user nova-compute[82850]: </disk>
Apr 12 07:49:46 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.utils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7b81c1-7c4f-4a6e-94cd-ef6bb261eea4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b92cf4-0f50-4e86-ab09-3ae38494cc00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[798a1c01-7c66-40cb-99ee-c8f46ec2495c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[654a688f-deb1-4c17-b8ee-b9ee57cd92a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:46 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f2e22-61d2-4dea-96c8-b1db864cc9b4]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.utils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating existing volume attachment record: a31b6a32-a1bf-4ad0-89fc-40956dbbe217 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.network.neutron [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updated VIF entry in instance network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.network.neutron [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285786.7150078, 00258d37-14c7-4657-b9c4-c636c93811ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:49:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully detached device vdb from instance 00258d37-14c7-4657-b9c4-c636c93811ce from the live domain config.
Apr 12 07:49:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPGjhBWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:46 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0a2b2-7886-4fa2-82cf-243f774cafdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:49:46 user nova-compute[82850]: No targets found.
Apr 12 07:49:46 user nova-compute[82850]: iSNS:
Apr 12 07:49:46 user nova-compute[82850]: No targets found.
Apr 12 07:49:46 user nova-compute[82850]: STATIC:
Apr 12 07:49:46 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90
Apr 12 07:49:46 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:46 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:46 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:49:46 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:46 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:46 user nova-compute[82850]: FIRMWARE:
Apr 12 07:49:46 user nova-compute[82850]: No targets found.
Apr 12 07:49:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:49:46 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:49:46 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[590081d8-358c-48ac-8476-736f4afbaf62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8684bd58-8a16-47a0-83d4-f5b71c5c61c6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:46 user nova-compute[82850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)
Apr 12 07:49:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:46 user nova-compute[82850]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 (non-flash)
Apr 12 07:49:46 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f193420cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8e12f3-8490-4367-afa9-200f4cfb0c90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[169cf4ed-3503-4959-9d89-a12a135e9895]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e85855-2427-4ab2-afdc-4dbb20c2bb43]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b714f-25b9-4703-908a-dd4131d5eadf]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e13d5a-5209-4b9f-b8b9-05c1f94c0700]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a1826-254e-489c-bd78-d9820ae16d85]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260]
Apr 12 07:49:47 user nova-compute[82850]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:47 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87767f4e-094f-4856-8f88-49054ae3b1fb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== disconnect_volume: return (305ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG nova.objects.instance [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.875s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.730s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:47 user nova-compute[82850]: INFO nova.compute.manager [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Terminating instance
Apr 12 07:49:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-unplugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] No waiting events found dispatching network-vif-unplugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-unplugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msiyTJnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:48 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e01be8-6511-4168-96f6-52dc0491a02e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:49:48 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ee2ee-7034-4fb6-971c-5a0e3b5dd879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe] added
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac8796d-7976-4cd9-af81-fd6c5f21adca]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca95d65-bb51-49f7-b6fd-e2816e676e65]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msiyTJnL {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msiyTJnL" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd542681-5813-4e7d-ad6f-56b7caaf8991]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msiyTJnL'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74676b-a594-4e97-945e-773d405c8722]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4a2b2-3c46-4990-97d6-2e8805c161a3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26360266-b43d-4e73-8ee8-85d047c2b98a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260]
Apr 12 07:49:48 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a0f4e6-b38c-4e2c-a16a-f3b976d3910e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86498a17-febc-41d7-a1bd-6c91cf0a51c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:48 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:48 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[475bef3f-e517-4685-a89c-6294fc1e683c]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msiyTJnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Instance destroyed successfully.
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'resources' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-989365315',display_name='tempest-VolumesSnapshotTestJSON-instance-989365315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-989365315',id=21,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:47:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-s5pxbcql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:47:40Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=00258d37-14c7-4657-b9c4-c636c93811ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "address": "fa:16:3e:83:5b:56", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5aa0b1a-8e", "ovs_interfaceid": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_vif [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5aa0b1a-8e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:49:48 user nova-compute[82850]: INFO os_vif [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:56,bridge_name='br-int',has_traffic_filtering=True,id=c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5aa0b1a-8e')
Apr 12 07:49:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPGjhBWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23639663265323165', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639663265323165', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.871s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.objects.instance [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d211c7-23ae-4078-aacc-9293bfaff59f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:49:49 user nova-compute[82850]: No targets found.
Apr 12 07:49:49 user nova-compute[82850]: iSNS:
Apr 12 07:49:49 user nova-compute[82850]: No targets found.
Apr 12 07:49:49 user nova-compute[82850]: STATIC:
Apr 12 07:49:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe
Apr 12 07:49:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:49 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:49:49 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:49 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:49 user nova-compute[82850]: FIRMWARE:
Apr 12 07:49:49 user nova-compute[82850]: No targets found.
Apr 12 07:49:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:49:49 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:49:49 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eca1c24-192a-426f-ba99-a899f2e68f90', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:49:49 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:49 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:49 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:49 user nova-compute[82850]:   <serial>3538e8ac-5519-4d52-92fc-1e55d8abdefe</serial>
Apr 12 07:49:49 user nova-compute[82850]: </disk>
Apr 12 07:49:49 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a28029-16c5-47dd-8939-e88cfbd73de1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11a0753-9bb3-4f28-ad50-93106ef2c3ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:49 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:49 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:49 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c4ec3a0>, {}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Disconnecting from: [] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== disconnect_volume: return (957ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:49:49 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Deleting instance files /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce_del
Apr 12 07:49:49 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Deletion of /opt/stack/data/nova/instances/00258d37-14c7-4657-b9c4-c636c93811ce_del complete
Apr 12 07:49:49 user nova-compute[82850]: INFO nova.compute.manager [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Took 1.86 seconds to destroy the instance on the hypervisor.
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:49:49 user nova-compute[82850]: INFO nova.compute.claims [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Claim successful on node user
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] No VIF found with MAC fa:16:3e:04:2c:ea, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.984s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Acquiring lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Lock "00258d37-14c7-4657-b9c4-c636c93811ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] No waiting events found dispatching network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:50 user nova-compute[82850]: WARNING nova.compute.manager [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received unexpected event network-vif-plugged-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance with vm_state active and task_state deleting.
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:50 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Took 0.75 seconds to deallocate network for instance.
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:49:50 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:49:50 user nova-compute[82850]: WARNING nova.volume.cinder [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Attachment 98675755-2522-46e6-b4fa-222065dc4156 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 98675755-2522-46e6-b4fa-222065dc4156. (HTTP 404) (Request-ID: req-a6f16163-5e45-4c98-a6de-19119241a341)
Apr 12 07:49:50 user nova-compute[82850]: INFO nova.compute.manager [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Received event network-vif-deleted-c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:50 user nova-compute[82850]: INFO nova.virt.block_device [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Booting with volume fe954cd5-982e-420d-b3e2-6da8bff98d9f at /dev/vda
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.utils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e71f2f-30a2-4351-a0ff-e11de5a7d8da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.policy [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6bbf9-a6d4-46f6-b89e-ebdc581f5812]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb874513-96d5-41fa-ba86-5e319a66737c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c0d975-687f-4b75-ac9a-b6df9cd59049]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:50 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:49:50 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbae9f0-f50d-479c-8412-0d4826c059f2]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG os_brick.utils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:50 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating existing volume attachment record: d77dcc1d-b8f7-487c-9dbf-aaa84c0de2c0 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwsGiBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:51 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc8ecf-251f-4c97-a53c-392b9b7a46b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:49:51 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5274f3-446d-48e8-afbd-7824e4fde6c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f] added
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae605b-57b6-4627-b62e-a3d7a5da67e4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b636adca-25b8-4331-9837-fd3c81b56e0a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIwsGiBF {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIwsGiBF" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795df16-0cab-4f7f-82ee-d065837a67ce]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.478s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIwsGiBF'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.compute.claims [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Claim successful on node user
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc3b77-2ed8-4767-b542-3b266a98459c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Deleted allocations for instance 00258d37-14c7-4657-b9c4-c636c93811ce
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf53533-29e0-45da-9146-c3e51652243a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db5f679-edad-4c61-a27e-08f6320f621d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260]
Apr 12 07:49:51 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00258d37-14c7-4657-b9c4-c636c93811ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.435s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5602219-2ad5-4ee6-9543-6f79b60d38a7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0f1ca-6e37-4f8f-918c-cf413d90144c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:51 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a38c1-a3f5-425c-a797-79f537ec0e4f]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwsGiBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Successfully created port: f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.861s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.compute.claims [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Claim successful on node user
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.compute.manager [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Detaching volume 3538e8ac-5519-4d52-92fc-1e55d8abdefe
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:49:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Creating image(s)
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "/opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "/opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "/opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG nova.policy [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:49:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: INFO nova.virt.block_device [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Attempting to driver detach volume 3538e8ac-5519-4d52-92fc-1e55d8abdefe from mountpoint /dev/vdb
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Attempting to detach device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:49:52 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:52 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:52 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:52 user nova-compute[82850]:   <serial>3538e8ac-5519-4d52-92fc-1e55d8abdefe</serial>
Apr 12 07:49:52 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:49:52 user nova-compute[82850]: </disk>
Apr 12 07:49:52 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:49:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the persistent domain config.
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:49:52 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:52 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:49:52 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:52 user nova-compute[82850]:   <serial>3538e8ac-5519-4d52-92fc-1e55d8abdefe</serial>
Apr 12 07:49:52 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:49:52 user nova-compute[82850]: </disk>
Apr 12 07:49:52 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.154s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk 1073741824" returned: 0 in 0.049s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23935613863326635', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935613863326635', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:49:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285792.5713978, 31672149-0612-4e15-aacd-e37c7536109c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:49:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully detached device vdb from instance 31672149-0612-4e15-aacd-e37c7536109c from the live domain config.
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msiyTJnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:52 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:49:52 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:52 user nova-compute[82850]:   <source dev="/dev/sdd"/>
Apr 12 07:49:52 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:49:52 user nova-compute[82850]:   <serial>845065d9-ece0-4d59-b500-cb1c3f40197f</serial>
Apr 12 07:49:52 user nova-compute[82850]: </disk>
Apr 12 07:49:52 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1ec269-12e4-461f-be62-e1fcbc3d9e15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:49:52 user nova-compute[82850]: No targets found.
Apr 12 07:49:52 user nova-compute[82850]: iSNS:
Apr 12 07:49:52 user nova-compute[82850]: No targets found.
Apr 12 07:49:52 user nova-compute[82850]: STATIC:
Apr 12 07:49:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe
Apr 12 07:49:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:49:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:49:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:49:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:49:52 user nova-compute[82850]: FIRMWARE:
Apr 12 07:49:52 user nova-compute[82850]: No targets found.
Apr 12 07:49:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:49:52 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:49:52 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Cannot resize image /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'migration_context' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16521db8-809f-43d9-a330-4a84ba082345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: INFO nova.virt.block_device [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Booting with blank volume at /dev/vda
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Ensure instance console log exists: /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9179c5d0-9334-42e0-9d2b-1de26defa5d3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:52 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:52 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:52 user nova-compute[82850]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe (non-flash)
Apr 12 07:49:52 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c5869e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.policy [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46012760-1d9d-4029-b242-44a4872ab325]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[243cb0d7-d668-4a4b-bd35-a7fa00004f94]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b2a3c-b0c2-4b6a-937a-8d04f62f62a4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a685bd6f-a3fd-4e78-a940-4a620ffaff08]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f197621-7edd-450b-81f8-cb3d881cae72]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5720f4e4-6881-4f28-a986-5f8a786b24bb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260]
Apr 12 07:49:52 user nova-compute[82850]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538e8ac-5519-4d52-92fc-1e55d8abdefe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f0dad-f850-47c7-87b6-2e91b3d856e7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] <== disconnect_volume: return (353ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:cd:6b:30, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.976s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Successfully updated port: f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-changed-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Refreshing instance network info cache due to event network-changed-f210361f-81f5-484d-b3a5-12fed9c8bb8b. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Acquiring lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Successfully created port: 8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:49:53 user nova-compute[82850]: INFO nova.compute.manager [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Rescuing
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Successfully created port: c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'flavor' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.010s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating instance_info_cache with network_info: [{"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Instance network_info: |[{"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Acquired lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Refreshing network info cache for port f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Successfully updated port: 8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-changed-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Refreshing instance network info cache due to event network-changed-8eee7860-e187-49d6-8595-784114b9fb4f. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance network_info: |[{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:54 user nova-compute[82850]: DEBUG nova.network.neutron [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Refreshing network info cache for port 8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updated VIF entry in instance network info cache for port f210361f-81f5-484d-b3a5-12fed9c8bb8b. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating instance_info_cache with network_info: [{"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Releasing lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updated VIF entry in instance network info cache for port 8eee7860-e187-49d6-8595-784114b9fb4f. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Successfully updated port: c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquired lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-changed-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Refreshing instance network info cache due to event network-changed-c6274ef0-ab83-498a-b9da-38ce679c28e9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Acquiring lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance destroyed successfully.
Apr 12 07:49:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Attempting rescue
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:49:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Creating image(s)
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.153s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue" returned: 0 in 0.083s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'migration_context' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start _get_guest_xml network_info=[{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:cd:6b:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976346504',display_name='tempest-ServerRescueNegativeTestJSON-server-1976346504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1976346504',id=22,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqGGXXPtvQkc4Q+1b1tPxLW6NgPiaphqfUdgbK5JXJXP525ewACIqwvdzXe6oF4g+7xY5gbo/sFkRUpVm0ItlkNFkuEY1IfoP9Pq3jpaEgq3F2toZknWB7N0LTVnEYTQg==',key_name='tempest-keypair-44620121',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-xjamlmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86009132a34b466399da1701f47316d9',uuid=2d96b11f-6cb6-4d16-acd3-94f7ae0c2350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:cd:6b:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "vif_mac": "fa:16:3e:cd:6b:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating instance_info_cache with network_info: [{"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:49:56 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Creating image(s)
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Ensure instance console log exists: /opt/stack/data/nova/instances/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Start _get_guest_xml network_info=[{"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'serial': 'fe954cd5-982e-420d-b3e2-6da8bff98d9f'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'd77dcc1d-b8f7-487c-9dbf-aaa84c0de2c0', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:49:56 user nova-compute[82850]:   <uuid>2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</uuid>
Apr 12 07:49:56 user nova-compute[82850]:   <name>instance-00000016</name>
Apr 12 07:49:56 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:49:56 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:49:56 user nova-compute[82850]:   <metadata>
Apr 12 07:49:56 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:49:56 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1976346504</nova:name>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:49:56</nova:creationTime>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:49:56 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:owner>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:user uuid="86009132a34b466399da1701f47316d9">tempest-ServerRescueNegativeTestJSON-1884068301-project-member</nova:user>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:project uuid="2b1c96acdf1f46f4b660de199d2b852b">tempest-ServerRescueNegativeTestJSON-1884068301</nova:project>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:owner>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:ports>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:port uuid="2805f98a-2ed0-4f69-b952-25ebe25cf704">
Apr 12 07:49:56 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:49:56 user nova-compute[82850]:         </nova:port>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:ports>
Apr 12 07:49:56 user nova-compute[82850]:     </nova:instance>
Apr 12 07:49:56 user nova-compute[82850]:   </metadata>
Apr 12 07:49:56 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:49:56 user nova-compute[82850]:     <system>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="serial">2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="uuid">2d96b11f-6cb6-4d16-acd3-94f7ae0c2350</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:49:56 user nova-compute[82850]:     </system>
Apr 12 07:49:56 user nova-compute[82850]:   </sysinfo>
Apr 12 07:49:56 user nova-compute[82850]:   <os>
Apr 12 07:49:56 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:49:56 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:49:56 user nova-compute[82850]:   </os>
Apr 12 07:49:56 user nova-compute[82850]:   <features>
Apr 12 07:49:56 user nova-compute[82850]:     <acpi/>
Apr 12 07:49:56 user nova-compute[82850]:     <apic/>
Apr 12 07:49:56 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:49:56 user nova-compute[82850]:   </features>
Apr 12 07:49:56 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:49:56 user nova-compute[82850]:   </clock>
Apr 12 07:49:56 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:49:56 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:49:56 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:49:56 user nova-compute[82850]:   </cpu>
Apr 12 07:49:56 user nova-compute[82850]:   <devices>
Apr 12 07:49:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:49:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:49:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue"/>
Apr 12 07:49:56 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:     </disk>
Apr 12 07:49:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:49:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:49:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk"/>
Apr 12 07:49:56 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:     </disk>
Apr 12 07:49:56 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:49:56 user nova-compute[82850]:       <mac address="fa:16:3e:cd:6b:30"/>
Apr 12 07:49:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:49:56 user nova-compute[82850]:       <target dev="tap2805f98a-2e"/>
Apr 12 07:49:56 user nova-compute[82850]:     </interface>
Apr 12 07:49:56 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:49:56 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/console.log" append="off"/>
Apr 12 07:49:56 user nova-compute[82850]:     </serial>
Apr 12 07:49:56 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:49:56 user nova-compute[82850]:     <video>
Apr 12 07:49:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:     </video>
Apr 12 07:49:56 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:49:56 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:49:56 user nova-compute[82850]:     </rng>
Apr 12 07:49:56 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:49:56 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:49:56 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:49:56 user nova-compute[82850]:     </memballoon>
Apr 12 07:49:56 user nova-compute[82850]:   </devices>
Apr 12 07:49:56 user nova-compute[82850]: </domain>
Apr 12 07:49:56 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Releasing lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Instance network_info: |[{"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Acquired lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Refreshing network info cache for port c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Start _get_guest_xml network_info=[{"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:56 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:56 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:49:56 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671601953',display_name='tempest-AttachVolumeTestJSON-server-671601953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671601953',id=26,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCedAa62t7wTvsMMaws5FD+HUmLenb3mQ4AwNRmz+5NlHwSxx+o2cxbVwQovpHZ/OrawGaz4PYDTmPhVUwUu7H+S0t7XDeKFrnIndqQ1jSYYzsPhBvnJ2fPVpdw6VG97eQ==',key_name='tempest-keypair-10133080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-4m0ayyyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=b36f9b90-b2e0-4b08-8ff1-8ce3994e149d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'pci_devices' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec238394-5d43-40c5-a324-be29eca87d49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:49:56 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance destroyed successfully.
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:49:56 user nova-compute[82850]:   <uuid>b36f9b90-b2e0-4b08-8ff1-8ce3994e149d</uuid>
Apr 12 07:49:56 user nova-compute[82850]:   <name>instance-0000001a</name>
Apr 12 07:49:56 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:49:56 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:49:56 user nova-compute[82850]:   <metadata>
Apr 12 07:49:56 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:49:56 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeTestJSON-server-671601953</nova:name>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:49:56</nova:creationTime>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:49:56 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:owner>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:user uuid="a555fa5e6680420e80fcc925a7540806">tempest-AttachVolumeTestJSON-1353175840-project-member</nova:user>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:project uuid="f7915d29fb124c838093eba0ee6cb69c">tempest-AttachVolumeTestJSON-1353175840</nova:project>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:owner>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:49:56 user nova-compute[82850]:       <nova:ports>
Apr 12 07:49:56 user nova-compute[82850]:         <nova:port uuid="c6274ef0-ab83-498a-b9da-38ce679c28e9">
Apr 12 07:49:56 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 07:49:56 user nova-compute[82850]:         </nova:port>
Apr 12 07:49:56 user nova-compute[82850]:       </nova:ports>
Apr 12 07:49:56 user nova-compute[82850]:     </nova:instance>
Apr 12 07:49:56 user nova-compute[82850]:   </metadata>
Apr 12 07:49:56 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:49:56 user nova-compute[82850]:     <system>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="serial">b36f9b90-b2e0-4b08-8ff1-8ce3994e149d</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="uuid">b36f9b90-b2e0-4b08-8ff1-8ce3994e149d</entry>
Apr 12 07:49:56 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:49:56 user nova-compute[82850]:     </system>
Apr 12 07:49:56 user nova-compute[82850]:   </sysinfo>
Apr 12 07:49:56 user nova-compute[82850]:   <os>
Apr 12 07:49:56 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:49:56 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:49:56 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:49:56 user nova-compute[82850]:   </os>
Apr 12 07:49:56 user nova-compute[82850]:   <features>
Apr 12 07:49:56 user nova-compute[82850]:     <acpi/>
Apr 12 07:49:56 user nova-compute[82850]:     <apic/>
Apr 12 07:49:56 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:49:56 user nova-compute[82850]:   </features>
Apr 12 07:49:56 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:49:56 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:49:56 user nova-compute[82850]:   </clock>
Apr 12 07:49:56 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:49:56 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:49:56 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:49:56 user nova-compute[82850]:   </cpu>
Apr 12 07:49:56 user nova-compute[82850]:   <devices>
Apr 12 07:49:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:49:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:49:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk"/>
Apr 12 07:49:56 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:     </disk>
Apr 12 07:49:56 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:49:56 user nova-compute[82850]:       <mac address="fa:16:3e:ca:b3:de"/>
Apr 12 07:49:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:49:56 user nova-compute[82850]:       <target dev="tapc6274ef0-ab"/>
Apr 12 07:49:56 user nova-compute[82850]:     </interface>
Apr 12 07:49:56 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:49:56 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/console.log" append="off"/>
Apr 12 07:49:56 user nova-compute[82850]:     </serial>
Apr 12 07:49:56 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:49:56 user nova-compute[82850]:     <video>
Apr 12 07:49:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:56 user nova-compute[82850]:     </video>
Apr 12 07:49:56 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:49:56 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:49:56 user nova-compute[82850]:     </rng>
Apr 12 07:49:56 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:49:56 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:49:56 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:49:56 user nova-compute[82850]:     </memballoon>
Apr 12 07:49:56 user nova-compute[82850]:   </devices>
Apr 12 07:49:56 user nova-compute[82850]: </domain>
Apr 12 07:49:56 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671601953',display_name='tempest-AttachVolumeTestJSON-server-671601953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671601953',id=26,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCedAa62t7wTvsMMaws5FD+HUmLenb3mQ4AwNRmz+5NlHwSxx+o2cxbVwQovpHZ/OrawGaz4PYDTmPhVUwUu7H+S0t7XDeKFrnIndqQ1jSYYzsPhBvnJ2fPVpdw6VG97eQ==',key_name='tempest-keypair-10133080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-4m0ayyyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=b36f9b90-b2e0-4b08-8ff1-8ce3994e149d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_vif [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6274ef0-ab, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6274ef0-ab, col_values=(('external_ids', {'iface-id': 'c6274ef0-ab83-498a-b9da-38ce679c28e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:b3:de', 'vm-uuid': 'b36f9b90-b2e0-4b08-8ff1-8ce3994e149d'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b48dfe-0994-42ab-88d3-4669b0c58fc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f] added
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:56 user nova-compute[82850]: INFO os_vif [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab')
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118d819-7363-467d-ada0-85b3e0969ac3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] No VIF found with MAC fa:16:3e:cd:6b:30, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9da9c8-ae67-443b-a010-c83efac4902d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQkbYjeV {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No VIF found with MAC fa:16:3e:ca:b3:de, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQkbYjeV" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac65eab-3328-4d6d-aae7-d1ad8d420492]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQkbYjeV'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1190773-56b9-4a45-a32f-b708651f3980]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4ed0f0-f12a-493e-aabc-a2f1dca80d81]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc22a7-b932-4ade-99e0-d4d0e76dd716]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]
Apr 12 07:49:56 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8848e39d-4f44-43b3-b03c-97df582b6847]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deba7c7-c79a-4632-928e-3c37c9366e0f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:49:56 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bedd0ab-5c82-436d-b9e1-2de41b0d5e01]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updated VIF entry in instance network info cache for port c6274ef0-ab83-498a-b9da-38ce679c28e9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating instance_info_cache with network_info: [{"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:49:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Releasing lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:57 user nova-compute[82850]: WARNING nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state active and task_state rescuing.
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:49:57 user nova-compute[82850]: WARNING nova.compute.manager [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state active and task_state rescuing.
Apr 12 07:49:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26366643132653666', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366643132653666', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1609383368',display_name='tempest-TestVolumeBootPattern-server-1609383368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1609383368',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-anofh05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:51Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.objects.instance [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:49:57 user nova-compute[82850]:   <uuid>53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb</uuid>
Apr 12 07:49:57 user nova-compute[82850]:   <name>instance-00000019</name>
Apr 12 07:49:57 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:49:57 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:49:57 user nova-compute[82850]:   <metadata>
Apr 12 07:49:57 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:49:57 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:49:57 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-server-1609383368</nova:name>
Apr 12 07:49:57 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:49:56</nova:creationTime>
Apr 12 07:49:57 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:49:57 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:49:57 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:49:57 user nova-compute[82850]:       <nova:owner>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:49:57 user nova-compute[82850]:       </nova:owner>
Apr 12 07:49:57 user nova-compute[82850]:       <nova:ports>
Apr 12 07:49:57 user nova-compute[82850]:         <nova:port uuid="f210361f-81f5-484d-b3a5-12fed9c8bb8b">
Apr 12 07:49:57 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 07:49:57 user nova-compute[82850]:         </nova:port>
Apr 12 07:49:57 user nova-compute[82850]:       </nova:ports>
Apr 12 07:49:57 user nova-compute[82850]:     </nova:instance>
Apr 12 07:49:57 user nova-compute[82850]:   </metadata>
Apr 12 07:49:57 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:49:57 user nova-compute[82850]:     <system>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="serial">53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb</entry>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="uuid">53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb</entry>
Apr 12 07:49:57 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:49:57 user nova-compute[82850]:     </system>
Apr 12 07:49:57 user nova-compute[82850]:   </sysinfo>
Apr 12 07:49:57 user nova-compute[82850]:   <os>
Apr 12 07:49:57 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:49:57 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:49:57 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:49:57 user nova-compute[82850]:   </os>
Apr 12 07:49:57 user nova-compute[82850]:   <features>
Apr 12 07:49:57 user nova-compute[82850]:     <acpi/>
Apr 12 07:49:57 user nova-compute[82850]:     <apic/>
Apr 12 07:49:57 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:49:57 user nova-compute[82850]:   </features>
Apr 12 07:49:57 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:49:57 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:49:57 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:49:57 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:49:57 user nova-compute[82850]:   </clock>
Apr 12 07:49:57 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:49:57 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:49:57 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:49:57 user nova-compute[82850]:   </cpu>
Apr 12 07:49:57 user nova-compute[82850]:   <devices>
Apr 12 07:49:57 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:49:57 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:49:57 user nova-compute[82850]:       <source dev="/dev/sdc"/>
Apr 12 07:49:57 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:49:57 user nova-compute[82850]:       <serial>fe954cd5-982e-420d-b3e2-6da8bff98d9f</serial>
Apr 12 07:49:57 user nova-compute[82850]:     </disk>
Apr 12 07:49:57 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:49:57 user nova-compute[82850]:       <mac address="fa:16:3e:c5:84:18"/>
Apr 12 07:49:57 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:57 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:49:57 user nova-compute[82850]:       <target dev="tapf210361f-81"/>
Apr 12 07:49:57 user nova-compute[82850]:     </interface>
Apr 12 07:49:57 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:49:57 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb/console.log" append="off"/>
Apr 12 07:49:57 user nova-compute[82850]:     </serial>
Apr 12 07:49:57 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:49:57 user nova-compute[82850]:     <video>
Apr 12 07:49:57 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:49:57 user nova-compute[82850]:     </video>
Apr 12 07:49:57 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:49:57 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:49:57 user nova-compute[82850]:     </rng>
Apr 12 07:49:57 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:49:57 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:49:57 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:49:57 user nova-compute[82850]:     </memballoon>
Apr 12 07:49:57 user nova-compute[82850]:   </devices>
Apr 12 07:49:57 user nova-compute[82850]: </domain>
Apr 12 07:49:57 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1609383368',display_name='tempest-TestVolumeBootPattern-server-1609383368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1609383368',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-anofh05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:51Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG os_vif [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf210361f-81, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf210361f-81, col_values=(('external_ids', {'iface-id': 'f210361f-81f5-484d-b3a5-12fed9c8bb8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:84:18', 'vm-uuid': '53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:57 user nova-compute[82850]: INFO os_vif [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81')
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:49:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:c5:84:18, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.utils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f0fcc-cdf7-42a1-a870-2ceefe88cdaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a132c1-0191-47f9-a4d4-f54f57eb2505]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c22cd-3b68-4463-9a3f-0fd08c3d297c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6899e0-a51a-4bf3-ae92-216c3e2f39e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:49:58 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:49:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3d21d-7d05-4018-ba6c-3ec488d89ddf]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG os_brick.utils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:49:58 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating existing volume attachment record: 01303d7c-ba7a-4127-aa02-e6887c4e1034 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:49:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:49:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] No waiting events found dispatching network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:00 user nova-compute[82850]: WARNING nova.compute.manager [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received unexpected event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance with vm_state building and task_state spawning.
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] No waiting events found dispatching network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:01 user nova-compute[82850]: WARNING nova.compute.manager [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received unexpected event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance with vm_state building and task_state spawning.
Apr 12 07:50:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Port d24db70b-543b-4549-8c33-b8276a776c3d binding to destination host user is already ACTIVE {{(pid=82850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] No waiting events found dispatching network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:02 user nova-compute[82850]: WARNING nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received unexpected event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance with vm_state building and task_state spawning.
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:02 user nova-compute[82850]: WARNING nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state active and task_state rescuing.
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:02 user nova-compute[82850]: WARNING nova.compute.manager [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state active and task_state rescuing.
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Creating tmpfile /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/tmp1elhenvi to verify with other compute node that the instance is on the same shared storage. {{(pid=82850) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Creating image(s)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Ensure instance console log exists: /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start _get_guest_xml network_info=[{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f136818-14e2-4d2e-81db-cb32a3ecd497', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9813c06-7a70-4358-8070-a77e87f88b30', 'serial': 'b9813c06-7a70-4358-8070-a77e87f88b30'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '01303d7c-ba7a-4127-aa02-e6887c4e1034', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:03 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:50:03 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4e0ec-3822-40e5-aac1-47b94fb65843]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:50:03 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf8412a-463a-4691-ba04-2fecd260c4d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30] added
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3be16-b82b-4a0e-a0f5-f18b18da63b9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[03075a06-9099-4a70-8f93-43c70faf9ac9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQXWwIeR {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQXWwIeR" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24c990-b0b6-429a-8304-dc7c69eb090a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQXWwIeR'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] No waiting events found dispatching network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received unexpected event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance with vm_state building and task_state spawning.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state resized and task_state resize_reverting.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING nova.compute.manager [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state resized and task_state resize_reverting.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f72f463-0489-4a88-ba05-b8a840fb924d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.3415213, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Resumed (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Instance spawned successfully.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f222ce-571b-4089-b10f-236f0db11eec]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Instance spawned successfully.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.342075, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Started (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e96170-a4ca-4560-b5ed-bba4900d55e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260]
Apr 12 07:50:03 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260] successful.
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d32c42-b921-4b78-902f-5cbcc4ca5277]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance destroyed successfully.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.3441815, b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] VM Resumed (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590b66e-af53-4fd7-9dfb-711c098822da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:48:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:03 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:03 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Took 11.59 seconds to spawn the instance on the hypervisor.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Took 7.20 seconds to spawn the instance on the hypervisor.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24db70b-54, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:03 user nova-compute[82850]: INFO os_vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb477986-3c76-4056-a9cd-25d511d5f8ef]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:50:03 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:50:03 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.3504848, b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] VM Started (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285788.7127178, 00258d37-14c7-4657-b9c4-c636c93811ce => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] VM Stopped (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Took 13.81 seconds to build instance.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-3ed53315-9550-4a1f-ad1e-cfeaeec758a1 None None] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.3522282, 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] VM Resumed (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Took 13.05 seconds to build instance.
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.951s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.182s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285803.3552182, 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:03 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] VM Started (Lifecycle Event)
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26233356464666262', 'path': '/dev/sde'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233356464666262', 'path': '/dev/sde'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.970s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[307793cc-8cf0-4e63-b876-ce88937a3068]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:50:04 user nova-compute[82850]: No targets found.
Apr 12 07:50:04 user nova-compute[82850]: iSNS:
Apr 12 07:50:04 user nova-compute[82850]: No targets found.
Apr 12 07:50:04 user nova-compute[82850]: STATIC:
Apr 12 07:50:04 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:50:04 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:50:04 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:50:04 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:50:04 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:50:04 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:50:04 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:50:04 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:50:04 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:50:04 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:50:04 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:50:04 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:50:04 user nova-compute[82850]: FIRMWARE:
Apr 12 07:50:04 user nova-compute[82850]: No targets found.
Apr 12 07:50:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:50:04 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:50:04 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-216955781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-216955781',id=27,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-g149p1ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:53Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=4f136818-14e2-4d2e-81db-cb32a3ecd497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:50:04 user nova-compute[82850]:   <uuid>4f136818-14e2-4d2e-81db-cb32a3ecd497</uuid>
Apr 12 07:50:04 user nova-compute[82850]:   <name>instance-0000001b</name>
Apr 12 07:50:04 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:50:04 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:50:04 user nova-compute[82850]:   <metadata>
Apr 12 07:50:04 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:50:04 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-216955781</nova:name>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:50:03</nova:creationTime>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:50:04 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:50:04 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:owner>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 07:50:04 user nova-compute[82850]:       </nova:owner>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:50:04 user nova-compute[82850]:       <nova:ports>
Apr 12 07:50:04 user nova-compute[82850]:         <nova:port uuid="8eee7860-e187-49d6-8595-784114b9fb4f">
Apr 12 07:50:04 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:50:04 user nova-compute[82850]:         </nova:port>
Apr 12 07:50:04 user nova-compute[82850]:       </nova:ports>
Apr 12 07:50:04 user nova-compute[82850]:     </nova:instance>
Apr 12 07:50:04 user nova-compute[82850]:   </metadata>
Apr 12 07:50:04 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:50:04 user nova-compute[82850]:     <system>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="serial">4f136818-14e2-4d2e-81db-cb32a3ecd497</entry>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="uuid">4f136818-14e2-4d2e-81db-cb32a3ecd497</entry>
Apr 12 07:50:04 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:50:04 user nova-compute[82850]:     </system>
Apr 12 07:50:04 user nova-compute[82850]:   </sysinfo>
Apr 12 07:50:04 user nova-compute[82850]:   <os>
Apr 12 07:50:04 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:50:04 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:50:04 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:50:04 user nova-compute[82850]:   </os>
Apr 12 07:50:04 user nova-compute[82850]:   <features>
Apr 12 07:50:04 user nova-compute[82850]:     <acpi/>
Apr 12 07:50:04 user nova-compute[82850]:     <apic/>
Apr 12 07:50:04 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:50:04 user nova-compute[82850]:   </features>
Apr 12 07:50:04 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:50:04 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:50:04 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:50:04 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:50:04 user nova-compute[82850]:   </clock>
Apr 12 07:50:04 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:50:04 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:50:04 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:50:04 user nova-compute[82850]:   </cpu>
Apr 12 07:50:04 user nova-compute[82850]:   <devices>
Apr 12 07:50:04 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:50:04 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:50:04 user nova-compute[82850]:       <source dev="/dev/sde"/>
Apr 12 07:50:04 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:50:04 user nova-compute[82850]:       <serial>b9813c06-7a70-4358-8070-a77e87f88b30</serial>
Apr 12 07:50:04 user nova-compute[82850]:     </disk>
Apr 12 07:50:04 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:50:04 user nova-compute[82850]:       <mac address="fa:16:3e:21:4a:a9"/>
Apr 12 07:50:04 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:04 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:50:04 user nova-compute[82850]:       <target dev="tap8eee7860-e1"/>
Apr 12 07:50:04 user nova-compute[82850]:     </interface>
Apr 12 07:50:04 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:50:04 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/console.log" append="off"/>
Apr 12 07:50:04 user nova-compute[82850]:     </serial>
Apr 12 07:50:04 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:50:04 user nova-compute[82850]:     <video>
Apr 12 07:50:04 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:04 user nova-compute[82850]:     </video>
Apr 12 07:50:04 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:50:04 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:50:04 user nova-compute[82850]:     </rng>
Apr 12 07:50:04 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:50:04 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:50:04 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:50:04 user nova-compute[82850]:     </memballoon>
Apr 12 07:50:04 user nova-compute[82850]:   </devices>
Apr 12 07:50:04 user nova-compute[82850]: </domain>
Apr 12 07:50:04 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-216955781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-216955781',id=27,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-g149p1ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:49:53Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=4f136818-14e2-4d2e-81db-cb32a3ecd497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_vif [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc037f-246d-4cb0-a9a5-7571d1841c5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eee7860-e1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eee7860-e1, col_values=(('external_ids', {'iface-id': '8eee7860-e187-49d6-8595-784114b9fb4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:4a:a9', 'vm-uuid': '4f136818-14e2-4d2e-81db-cb32a3ecd497'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:04 user nova-compute[82850]: INFO os_vif [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1')
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e214ef0-d477-4aef-b1f0-db4a2e42d087]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:04 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c1af2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6ee13-3e17-4e86-acee-8139a661a7b6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:21:4a:a9, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6749531-8489-492a-8d75-6b84b62fc21f]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c55fa7-67d9-4ca3-a362-8a742a11e894]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d7efd-99e8-4f8a-8871-0ab6e9de3fc8]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb2ca5-177b-442e-8d37-6ca1aad25612]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03df98-9686-43ad-9e1b-6965aceb2571]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:50:04 user nova-compute[82850]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:50:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e77d2d-be52-4040-b892-9509a3074f30]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (1376ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:50:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'migration_context' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:06 user nova-compute[82850]: WARNING nova.compute.manager [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state building and task_state spawning.
Apr 12 07:50:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:50:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.596s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:07 user nova-compute[82850]: INFO nova.compute.manager [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Swapping old allocation on dict_keys(['27ffe403-b11c-48c3-a0f8-372b48def01d']) held by migration d5339f06-d7d3-49d4-a585-a78bf7a1c605 for instance
Apr 12 07:50:07 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Overwriting current allocation {'allocations': {'27ffe403-b11c-48c3-a0f8-372b48def01d': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'consumer_generation': 1} on consumer 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-3b7424e4-52aa-4330-a748-006240372716" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG os_brick.utils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcdffeb-b471-431d-856f-31ede5d12e71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6eb0fc-4335-4985-95af-7cf038baf273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94489aa9-6a03-4edf-ac6e-70d9e234263b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7be2c-7ab5-43ee-a0d5-5728fedae866]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:50:07 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:50:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d83bb4-9068-4d42-84ae-5c8d727cf386]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:50:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG os_brick.utils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:08 user nova-compute[82850]: WARNING nova.compute.manager [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state building and task_state spawning.
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285808.6545389, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Resumed (Lifecycle Event)
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance spawned successfully.
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285808.6553564, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Started (Lifecycle Event)
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 12 07:50:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:08 user nova-compute[82850]: INFO nova.compute.manager [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Took 18.09 seconds to build instance.
Apr 12 07:50:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.220s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Starting finish_revert_migration {{(pid=82850) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start _get_guest_xml network_info=[{"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b7424e4-52aa-4330-a748-006240372716', 'attached_at': '2023-04-12T07:50:12.000000', 'detached_at': '', 'volume_id': '894167f3-141a-4eb7-80a6-60d5af7aada7', 'serial': '894167f3-141a-4eb7-80a6-60d5af7aada7'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '1c61cb59-24e3-47ba-98a9-f3a4a1130b10', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:50:12 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:12 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:50:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:50:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:50:12 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff068b-d332-4de5-a9f4-73d8fe90ce34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:50:12 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45e81a-3ee9-4483-a0ad-713471771117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7] added
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d2b788-2fc4-45b5-81c8-88c7c6fb520c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7688b-940d-4fe3-a533-af429cefcbcf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHQspbel" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a966ee-2d3c-4df8-9f55-a313d6e102f4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHQspbel'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068fb32-2673-4fb8-9c78-1af5702fba57]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492217c-5cd1-429a-abea-16a3d6224e22]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd05746-86aa-4704-8c3b-efc5a48d445e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:50:12 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c932835-25f1-4723-aa96-4cd171e393c1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdee398-87ed-43a1-96e0-763faf58bcf6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:50:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:50:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:13 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba41eee-15a2-41c1-8289-0e860d441ab5]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:50:13 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:50:13 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036616464656536', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:48:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:50:14 user nova-compute[82850]:   <uuid>3b7424e4-52aa-4330-a748-006240372716</uuid>
Apr 12 07:50:14 user nova-compute[82850]:   <name>instance-00000004</name>
Apr 12 07:50:14 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:50:14 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:50:14 user nova-compute[82850]:   <metadata>
Apr 12 07:50:14 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:50:14 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-926530387</nova:name>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:50:12</nova:creationTime>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:50:14 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:50:14 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:owner>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:50:14 user nova-compute[82850]:       </nova:owner>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:50:14 user nova-compute[82850]:       <nova:ports>
Apr 12 07:50:14 user nova-compute[82850]:         <nova:port uuid="d24db70b-543b-4549-8c33-b8276a776c3d">
Apr 12 07:50:14 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:50:14 user nova-compute[82850]:         </nova:port>
Apr 12 07:50:14 user nova-compute[82850]:       </nova:ports>
Apr 12 07:50:14 user nova-compute[82850]:     </nova:instance>
Apr 12 07:50:14 user nova-compute[82850]:   </metadata>
Apr 12 07:50:14 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:50:14 user nova-compute[82850]:     <system>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="serial">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="uuid">3b7424e4-52aa-4330-a748-006240372716</entry>
Apr 12 07:50:14 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:50:14 user nova-compute[82850]:     </system>
Apr 12 07:50:14 user nova-compute[82850]:   </sysinfo>
Apr 12 07:50:14 user nova-compute[82850]:   <os>
Apr 12 07:50:14 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:50:14 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:50:14 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:50:14 user nova-compute[82850]:   </os>
Apr 12 07:50:14 user nova-compute[82850]:   <features>
Apr 12 07:50:14 user nova-compute[82850]:     <acpi/>
Apr 12 07:50:14 user nova-compute[82850]:     <apic/>
Apr 12 07:50:14 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:50:14 user nova-compute[82850]:   </features>
Apr 12 07:50:14 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:50:14 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:50:14 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:50:14 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:50:14 user nova-compute[82850]:   </clock>
Apr 12 07:50:14 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:50:14 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:50:14 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:50:14 user nova-compute[82850]:   </cpu>
Apr 12 07:50:14 user nova-compute[82850]:   <devices>
Apr 12 07:50:14 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:50:14 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:50:14 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk"/>
Apr 12 07:50:14 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:50:14 user nova-compute[82850]:     </disk>
Apr 12 07:50:14 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:50:14 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:50:14 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:50:14 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:50:14 user nova-compute[82850]:       <serial>894167f3-141a-4eb7-80a6-60d5af7aada7</serial>
Apr 12 07:50:14 user nova-compute[82850]:     </disk>
Apr 12 07:50:14 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:50:14 user nova-compute[82850]:       <mac address="fa:16:3e:d5:f3:b1"/>
Apr 12 07:50:14 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:14 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:50:14 user nova-compute[82850]:       <target dev="tapd24db70b-54"/>
Apr 12 07:50:14 user nova-compute[82850]:     </interface>
Apr 12 07:50:14 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:50:14 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/console.log" append="off"/>
Apr 12 07:50:14 user nova-compute[82850]:     </serial>
Apr 12 07:50:14 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:50:14 user nova-compute[82850]:     <video>
Apr 12 07:50:14 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:14 user nova-compute[82850]:     </video>
Apr 12 07:50:14 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:50:14 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:50:14 user nova-compute[82850]:     </rng>
Apr 12 07:50:14 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:50:14 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:50:14 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:50:14 user nova-compute[82850]:     </memballoon>
Apr 12 07:50:14 user nova-compute[82850]:   </devices>
Apr 12 07:50:14 user nova-compute[82850]: </domain>
Apr 12 07:50:14 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:48:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG os_vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24db70b-54, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd24db70b-54, col_values=(('external_ids', {'iface-id': 'd24db70b-543b-4549-8c33-b8276a776c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f3:b1', 'vm-uuid': '3b7424e4-52aa-4330-a748-006240372716'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:14 user nova-compute[82850]: INFO os_vif [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:50:14 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 07:50:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:15 user nova-compute[82850]: WARNING nova.compute.manager [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state resized and task_state resize_reverting.
Apr 12 07:50:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 3b7424e4-52aa-4330-a748-006240372716 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285817.797768, 3b7424e4-52aa-4330-a748-006240372716 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Resumed (Lifecycle Event)
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance running successfully.
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:17 user nova-compute[82850]: WARNING nova.compute.manager [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state resized and task_state resize_reverting.
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] finish_revert_migration finished successfully. {{(pid=82850) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285817.8052857, 3b7424e4-52aa-4330-a748-006240372716 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Started (Lifecycle Event)
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:17 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 07:50:18 user nova-compute[82850]: INFO nova.compute.manager [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance to original state: 'active'
Apr 12 07:50:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:50:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:21 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:50:22 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:24 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7543MB free_disk=26.132854461669922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 31672149-0612-4e15-aacd-e37c7536109c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 40c8d6d7-d840-4417-b897-92ff8258d984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:50:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:50:25 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:50:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.739s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:50:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:31 user nova-compute[82850]: INFO nova.compute.manager [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Terminating instance
Apr 12 07:50:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-unplugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] No waiting events found dispatching network-vif-unplugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-unplugged-43a66fc3-42b3-49e6-bbb8-514842e2200f for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:50:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Instance destroyed successfully.
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lazy-loading 'resources' on Instance uuid bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-35389323',display_name='tempest-VolumesNegativeTest-instance-35389323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-35389323',id=23,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='853e85be61864e66b0b8e8be4e3059fa',ramdisk_id='',reservation_id='r-pzad5ftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-653023601',owner_user_name='tempest-VolumesNegativeTest-653023601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:48:48Z,user_data=None,user_id='66018ab9b9c54fc593b4f872f6ef4c9a',uuid=bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converting VIF {"id": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "address": "fa:16:3e:b7:20:2d", "network": {"id": "6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b57523dc439f4bd8adaf36cb3610ca4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a66fc3-42", "ovs_interfaceid": "43a66fc3-42b3-49e6-bbb8-514842e2200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG os_vif [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a66fc3-42, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:32 user nova-compute[82850]: INFO os_vif [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:20:2d,bridge_name='br-int',has_traffic_filtering=True,id=43a66fc3-42b3-49e6-bbb8-514842e2200f,network=Network(6ba7fa5f-18ff-4bc6-86a6-402e3c2fa3ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a66fc3-42')
Apr 12 07:50:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Deleting instance files /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16_del
Apr 12 07:50:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Deletion of /opt/stack/data/nova/instances/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16_del complete
Apr 12 07:50:32 user nova-compute[82850]: INFO nova.compute.manager [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 07:50:32 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:32 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Took 0.45 seconds to deallocate network for instance.
Apr 12 07:50:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-deleted-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:33 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Deleted allocations for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16
Apr 12 07:50:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Acquiring lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Lock "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] No waiting events found dispatching network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:33 user nova-compute[82850]: WARNING nova.compute.manager [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Received unexpected event network-vif-plugged-43a66fc3-42b3-49e6-bbb8-514842e2200f for instance with vm_state deleted and task_state None.
Apr 12 07:50:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:46 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:50:46 user nova-compute[82850]: INFO nova.compute.claims [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Claim successful on node user
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285832.2408113, bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:47 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] VM Stopped (Lifecycle Event)
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c1ac0674-e4fa-4613-a5a9-2eaae43ac948 None None] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:50:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.policy [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:50:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Creating image(s)
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "/opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "/opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "/opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk 1073741824" returned: 0 in 0.049s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Cannot resize image /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'migration_context' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Ensure instance console log exists: /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Successfully created port: 5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Successfully updated port: 5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquired lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-changed-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Refreshing instance network info cache due to event network-changed-5717efd2-8b2e-42b5-bd06-baa345aab97c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Acquiring lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updating instance_info_cache with network_info: [{"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Releasing lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Instance network_info: |[{"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Acquired lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.neutron [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Refreshing network info cache for port 5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Start _get_guest_xml network_info=[{"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:50:49 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:49 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-424170650',display_name='tempest-VolumesSnapshotTestJSON-instance-424170650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-424170650',id=28,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-a79rv8j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:50:48Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=c33e7825-1766-472a-8f09-c17a239fe63b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'pci_devices' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:50:49 user nova-compute[82850]:   <uuid>c33e7825-1766-472a-8f09-c17a239fe63b</uuid>
Apr 12 07:50:49 user nova-compute[82850]:   <name>instance-0000001c</name>
Apr 12 07:50:49 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:50:49 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:50:49 user nova-compute[82850]:   <metadata>
Apr 12 07:50:49 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:50:49 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-424170650</nova:name>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:50:49</nova:creationTime>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:50:49 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:50:49 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:owner>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:user uuid="76d4eef76f634fb39c1f0895abfbd17d">tempest-VolumesSnapshotTestJSON-1434579998-project-member</nova:user>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:project uuid="468e9932c7634b0d8c3257ee14a66959">tempest-VolumesSnapshotTestJSON-1434579998</nova:project>
Apr 12 07:50:49 user nova-compute[82850]:       </nova:owner>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:50:49 user nova-compute[82850]:       <nova:ports>
Apr 12 07:50:49 user nova-compute[82850]:         <nova:port uuid="5717efd2-8b2e-42b5-bd06-baa345aab97c">
Apr 12 07:50:49 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 07:50:49 user nova-compute[82850]:         </nova:port>
Apr 12 07:50:49 user nova-compute[82850]:       </nova:ports>
Apr 12 07:50:49 user nova-compute[82850]:     </nova:instance>
Apr 12 07:50:49 user nova-compute[82850]:   </metadata>
Apr 12 07:50:49 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:50:49 user nova-compute[82850]:     <system>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="serial">c33e7825-1766-472a-8f09-c17a239fe63b</entry>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="uuid">c33e7825-1766-472a-8f09-c17a239fe63b</entry>
Apr 12 07:50:49 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:50:49 user nova-compute[82850]:     </system>
Apr 12 07:50:49 user nova-compute[82850]:   </sysinfo>
Apr 12 07:50:49 user nova-compute[82850]:   <os>
Apr 12 07:50:49 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:50:49 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:50:49 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:50:49 user nova-compute[82850]:   </os>
Apr 12 07:50:49 user nova-compute[82850]:   <features>
Apr 12 07:50:49 user nova-compute[82850]:     <acpi/>
Apr 12 07:50:49 user nova-compute[82850]:     <apic/>
Apr 12 07:50:49 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:50:49 user nova-compute[82850]:   </features>
Apr 12 07:50:49 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:50:49 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:50:49 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:50:49 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:50:49 user nova-compute[82850]:   </clock>
Apr 12 07:50:49 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:50:49 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:50:49 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:50:49 user nova-compute[82850]:   </cpu>
Apr 12 07:50:49 user nova-compute[82850]:   <devices>
Apr 12 07:50:49 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:50:49 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:50:49 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk"/>
Apr 12 07:50:49 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:50:49 user nova-compute[82850]:     </disk>
Apr 12 07:50:49 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:50:49 user nova-compute[82850]:       <mac address="fa:16:3e:f6:d4:5b"/>
Apr 12 07:50:49 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:49 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:50:49 user nova-compute[82850]:       <target dev="tap5717efd2-8b"/>
Apr 12 07:50:49 user nova-compute[82850]:     </interface>
Apr 12 07:50:49 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:50:49 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/console.log" append="off"/>
Apr 12 07:50:49 user nova-compute[82850]:     </serial>
Apr 12 07:50:49 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:50:49 user nova-compute[82850]:     <video>
Apr 12 07:50:49 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:50:49 user nova-compute[82850]:     </video>
Apr 12 07:50:49 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:50:49 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:50:49 user nova-compute[82850]:     </rng>
Apr 12 07:50:49 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:50:49 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:50:49 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:50:49 user nova-compute[82850]:     </memballoon>
Apr 12 07:50:49 user nova-compute[82850]:   </devices>
Apr 12 07:50:49 user nova-compute[82850]: </domain>
Apr 12 07:50:49 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-424170650',display_name='tempest-VolumesSnapshotTestJSON-instance-424170650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-424170650',id=28,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-a79rv8j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:50:48Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=c33e7825-1766-472a-8f09-c17a239fe63b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG os_vif [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5717efd2-8b, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5717efd2-8b, col_values=(('external_ids', {'iface-id': '5717efd2-8b2e-42b5-bd06-baa345aab97c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:d4:5b', 'vm-uuid': 'c33e7825-1766-472a-8f09-c17a239fe63b'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:49 user nova-compute[82850]: INFO os_vif [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b')
Apr 12 07:50:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:50:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No VIF found with MAC fa:16:3e:f6:d4:5b, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:50:50 user nova-compute[82850]: DEBUG nova.network.neutron [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updated VIF entry in instance network info cache for port 5717efd2-8b2e-42b5-bd06-baa345aab97c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:50:50 user nova-compute[82850]: DEBUG nova.network.neutron [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updating instance_info_cache with network_info: [{"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Releasing lock "refresh_cache-c33e7825-1766-472a-8f09-c17a239fe63b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:51 user nova-compute[82850]: WARNING nova.compute.manager [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state building and task_state spawning.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:53 user nova-compute[82850]: WARNING nova.compute.manager [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state building and task_state spawning.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285853.663659, c33e7825-1766-472a-8f09-c17a239fe63b => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] VM Resumed (Lifecycle Event)
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Instance spawned successfully.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285853.665596, c33e7825-1766-472a-8f09-c17a239fe63b => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] VM Started (Lifecycle Event)
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:50:53 user nova-compute[82850]: INFO nova.compute.manager [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Took 6.97 seconds to build instance.
Apr 12 07:50:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing instance network info cache due to event network-changed-717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:50:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Acquiring lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:50:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Acquired lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:50:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Refreshing network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:50:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updated VIF entry in instance network info cache for port 717e6ad1-b01a-4647-8a55-6fe494a39c4a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:50:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating instance_info_cache with network_info: [{"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:50:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Releasing lock "refresh_cache-31672149-0612-4e15-aacd-e37c7536109c" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:58 user nova-compute[82850]: INFO nova.compute.manager [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Terminating instance
Apr 12 07:50:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-unplugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] No waiting events found dispatching network-vif-unplugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-unplugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:50:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Instance destroyed successfully.
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'resources' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352660305',display_name='tempest-SnapshotDataIntegrityTests-server-1352660305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352660305',id=18,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKY3IfLbQtlg9TTvQ4KUShSpDfiYSwffhY1f5sy0yXcOfZzR2YPa+yu4MsobcQPV5jgbrwG1tvBCtM7wUngdWCr1fKuPVs1PI6G5g3xFfWG8LfUY5f9YX3pJC+Y/2sgug==',key_name='tempest-SnapshotDataIntegrityTests-33494310',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dbbd1aa653244a39d6c81f2b9d669f5',ramdisk_id='',reservation_id='r-lvykmi55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-330964735',owner_user_name='tempest-SnapshotDataIntegrityTests-330964735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:44:43Z,user_data=None,user_id='775732b835f44e7baf889683808bb3dd',uuid=31672149-0612-4e15-aacd-e37c7536109c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converting VIF {"id": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "address": "fa:16:3e:04:2c:ea", "network": {"id": "6599b73f-f1e9-42c9-a7bf-8208291d4abf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1829582315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbbd1aa653244a39d6c81f2b9d669f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6ad1-b0", "ovs_interfaceid": "717e6ad1-b01a-4647-8a55-6fe494a39c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG os_vif [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717e6ad1-b0, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:50:59 user nova-compute[82850]: INFO os_vif [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2c:ea,bridge_name='br-int',has_traffic_filtering=True,id=717e6ad1-b01a-4647-8a55-6fe494a39c4a,network=Network(6599b73f-f1e9-42c9-a7bf-8208291d4abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6ad1-b0')
Apr 12 07:50:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Deleting instance files /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c_del
Apr 12 07:50:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Deletion of /opt/stack/data/nova/instances/31672149-0612-4e15-aacd-e37c7536109c_del complete
Apr 12 07:50:59 user nova-compute[82850]: INFO nova.compute.manager [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 07:50:59 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:50:59 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:51:00 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:00 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Took 0.49 seconds to deallocate network for instance.
Apr 12 07:51:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:00 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:51:00 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:51:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:00 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Deleted allocations for instance 31672149-0612-4e15-aacd-e37c7536109c
Apr 12 07:51:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "31672149-0612-4e15-aacd-e37c7536109c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Acquiring lock "31672149-0612-4e15-aacd-e37c7536109c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Lock "31672149-0612-4e15-aacd-e37c7536109c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] No waiting events found dispatching network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:01 user nova-compute[82850]: WARNING nova.compute.manager [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received unexpected event network-vif-plugged-717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance with vm_state deleted and task_state None.
Apr 12 07:51:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Received event network-vif-deleted-717e6ad1-b01a-4647-8a55-6fe494a39c4a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:14 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285859.6085618, 31672149-0612-4e15-aacd-e37c7536109c => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:14 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 31672149-0612-4e15-aacd-e37c7536109c] VM Stopped (Lifecycle Event)
Apr 12 07:51:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ecb59eb8-167e-4b27-887a-05a4ca4e5372 None None] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:16 user nova-compute[82850]: INFO nova.compute.manager [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Attaching volume 957dad42-1b5b-4347-b512-2459774d09f4 to /dev/vdb
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69912c-93d8-44e6-bb1b-7c481c3e0f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede98720-592d-4843-b3be-eb23b5295214]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d86dde-8dee-47e2-9431-1a56d9cfa47f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c45ffc-4df7-4f4c-baab-7aec8f28e06e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:16 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:51:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30328009-6cf6-4655-9231-83f39c69dc4e]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG os_brick.utils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:16 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating existing volume attachment record: f9d06c78-fe78-4ffa-b8c7-6c3d41b45526 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:51:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:20 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:20 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:20 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e561d-0d70-4780-93ab-69edad9c054a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:51:20 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[506427f3-f36d-49b6-835b-98a98514d7b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4] added
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b2bfc-ea86-4825-bf21-9762b99bc70e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5ff725-58c8-4450-813c-f708add255cb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAKMuSwg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAKMuSwg" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e7501-3099-4f22-a926-0908525bc1f4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAKMuSwg'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc93cd4-2d98-450d-92e1-daae66292a9b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9dd41-0599-4275-91c7-8ced9b9abc82]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c044c0c-0115-44b1-8780-0afdf3ba5542]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]
Apr 12 07:51:20 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f1c9f0-8222-46e6-a047-73efe541d77e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9d8d8-61bf-44be-b6d9-455ab824cd15]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:20 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c29885d-9119-4a85-9efc-3d66716ad6a3]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:20 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23436353064633065', 'path': '/dev/sdf'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436353064633065', 'path': '/dev/sdf'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:21 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:51:21 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:51:21 user nova-compute[82850]:   <source dev="/dev/sdf"/>
Apr 12 07:51:21 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:51:21 user nova-compute[82850]:   <serial>957dad42-1b5b-4347-b512-2459774d09f4</serial>
Apr 12 07:51:21 user nova-compute[82850]: </disk>
Apr 12 07:51:21 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No VIF found with MAC fa:16:3e:4d:b3:b8, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.279s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=26.150348663330078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 40c8d6d7-d840-4417-b897-92ff8258d984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c33e7825-1766-472a-8f09-c17a239fe63b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing instance network info cache due to event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:51:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updated VIF entry in instance network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing instance network info cache due to event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:29 user nova-compute[82850]: DEBUG nova.network.neutron [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:51:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updated VIF entry in instance network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:51:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:32 user nova-compute[82850]: INFO nova.compute.manager [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Rebooting instance
Apr 12 07:51:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:33 user nova-compute[82850]: WARNING nova.compute.manager [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance destroyed successfully.
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'resources' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:51:33Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c395303-b0, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:51:33 user nova-compute[82850]: INFO os_vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0')
Apr 12 07:51:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:33 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27cadc-5007-4abd-ac84-8d6ad494b8dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:51:33 user nova-compute[82850]: No targets found.
Apr 12 07:51:33 user nova-compute[82850]: iSNS:
Apr 12 07:51:33 user nova-compute[82850]: No targets found.
Apr 12 07:51:33 user nova-compute[82850]: STATIC:
Apr 12 07:51:33 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:51:33 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:33 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:33 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:51:33 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:33 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:33 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:51:33 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:33 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:33 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:51:33 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:33 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:33 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:51:33 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:33 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:33 user nova-compute[82850]: FIRMWARE:
Apr 12 07:51:33 user nova-compute[82850]: No targets found.
Apr 12 07:51:33 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:51:33 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:51:33 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f9da5e-179e-4fdf-a8cf-2e57c5f4b19d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d53980-7cd1-4d66-9682-2b61e4c1894f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0f5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4'): ({'sdf'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Removing single pathed devices sdf {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fe1e64-c009-426b-83c5-c5762a8a3b5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6f735-6167-4e83-bef0-8a846a10469c]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flushing IO for device /dev/sdf {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd9eea6-a7ba-4264-bbf8-2467b15fd531]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cebd5f5-1a67-4b4e-9e61-2190f02a9854]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb808626-5227-4f27-bd23-cd7a9258f78a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe2e69-8990-4e21-9a61-5d7019647cb4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]
Apr 12 07:51:34 user nova-compute[82850]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f84de-d819-4dd9-8f46-d23deec054c0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== disconnect_volume: return (306ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start _get_guest_xml network_info=[{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=47938fc9-ecf8-4c1a-8f19-67593f191ec6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '47938fc9-ecf8-4c1a-8f19-67593f191ec6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '40c8d6d7-d840-4417-b897-92ff8258d984', 'attached_at': '', 'detached_at': '', 'volume_id': '957dad42-1b5b-4347-b512-2459774d09f4', 'serial': '957dad42-1b5b-4347-b512-2459774d09f4'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'f9d06c78-fe78-4ffa-b8c7-6c3d41b45526', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:51:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=47938fc9-ecf8-4c1a-8f19-67593f191ec6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:34 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[02657a53-a5a0-4f4e-8b9c-d072830235c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:51:34 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23dbf8b-8274-4226-9609-4c0aab6af31a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4] added
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e128ad-b399-402e-ba34-d945580247c2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47dac40-8e23-4ac1-8ddd-a780b7f08fe7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAKMuSwg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAKMuSwg" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd18021-89cc-43ed-aef5-7254619721f3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAKMuSwg'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a11ae5-8c08-4ad4-81b0-34c2a4a54f1a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a4acb-8f3f-4665-a3b5-d17bc20eed37]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b2fdd-03dd-4fb3-9342-7b6ebf6ade24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]
Apr 12 07:51:34 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a44dea5-94e9-4813-b402-bc3889988aad]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5ade3-63be-47bf-af86-95bea2f3c04a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f77973-7e27-4d0b-8fe5-d26a5f614cc6]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:51:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:35 user nova-compute[82850]: WARNING nova.compute.manager [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 07:51:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23436353064633065', 'path': '/dev/sdf'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436353064633065', 'path': '/dev/sdf'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:51:33Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'pci_devices' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:51:35 user nova-compute[82850]:   <uuid>40c8d6d7-d840-4417-b897-92ff8258d984</uuid>
Apr 12 07:51:35 user nova-compute[82850]:   <name>instance-00000018</name>
Apr 12 07:51:35 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:51:35 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:51:35 user nova-compute[82850]:   <metadata>
Apr 12 07:51:35 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:51:35 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:name>tempest-TestMinimumBasicScenario-server-381898933</nova:name>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:51:34</nova:creationTime>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:51:35 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:51:35 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:owner>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:user uuid="630f8381d3534fd3a1978fc0a931e8c0">tempest-TestMinimumBasicScenario-1759703879-project-member</nova:user>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:project uuid="27f4f7b1930e48cb82f5f6010872e221">tempest-TestMinimumBasicScenario-1759703879</nova:project>
Apr 12 07:51:35 user nova-compute[82850]:       </nova:owner>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:root type="image" uuid="47938fc9-ecf8-4c1a-8f19-67593f191ec6"/>
Apr 12 07:51:35 user nova-compute[82850]:       <nova:ports>
Apr 12 07:51:35 user nova-compute[82850]:         <nova:port uuid="8c395303-b043-4eef-a6ac-e567893e6de4">
Apr 12 07:51:35 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 07:51:35 user nova-compute[82850]:         </nova:port>
Apr 12 07:51:35 user nova-compute[82850]:       </nova:ports>
Apr 12 07:51:35 user nova-compute[82850]:     </nova:instance>
Apr 12 07:51:35 user nova-compute[82850]:   </metadata>
Apr 12 07:51:35 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:51:35 user nova-compute[82850]:     <system>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="serial">40c8d6d7-d840-4417-b897-92ff8258d984</entry>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="uuid">40c8d6d7-d840-4417-b897-92ff8258d984</entry>
Apr 12 07:51:35 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:51:35 user nova-compute[82850]:     </system>
Apr 12 07:51:35 user nova-compute[82850]:   </sysinfo>
Apr 12 07:51:35 user nova-compute[82850]:   <os>
Apr 12 07:51:35 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:51:35 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:51:35 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:51:35 user nova-compute[82850]:   </os>
Apr 12 07:51:35 user nova-compute[82850]:   <features>
Apr 12 07:51:35 user nova-compute[82850]:     <acpi/>
Apr 12 07:51:35 user nova-compute[82850]:     <apic/>
Apr 12 07:51:35 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:51:35 user nova-compute[82850]:   </features>
Apr 12 07:51:35 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:51:35 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:51:35 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:51:35 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:51:35 user nova-compute[82850]:   </clock>
Apr 12 07:51:35 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:51:35 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:51:35 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:51:35 user nova-compute[82850]:   </cpu>
Apr 12 07:51:35 user nova-compute[82850]:   <devices>
Apr 12 07:51:35 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:51:35 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:51:35 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk"/>
Apr 12 07:51:35 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:51:35 user nova-compute[82850]:     </disk>
Apr 12 07:51:35 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:51:35 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:51:35 user nova-compute[82850]:       <source dev="/dev/sdf"/>
Apr 12 07:51:35 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:51:35 user nova-compute[82850]:       <serial>957dad42-1b5b-4347-b512-2459774d09f4</serial>
Apr 12 07:51:35 user nova-compute[82850]:     </disk>
Apr 12 07:51:35 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:51:35 user nova-compute[82850]:       <mac address="fa:16:3e:4d:b3:b8"/>
Apr 12 07:51:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:51:35 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:51:35 user nova-compute[82850]:       <target dev="tap8c395303-b0"/>
Apr 12 07:51:35 user nova-compute[82850]:     </interface>
Apr 12 07:51:35 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:51:35 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/console.log" append="off"/>
Apr 12 07:51:35 user nova-compute[82850]:     </serial>
Apr 12 07:51:35 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:51:35 user nova-compute[82850]:     <video>
Apr 12 07:51:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:51:35 user nova-compute[82850]:     </video>
Apr 12 07:51:35 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:51:35 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:51:35 user nova-compute[82850]:     </rng>
Apr 12 07:51:35 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:51:35 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:51:35 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:51:35 user nova-compute[82850]:     </memballoon>
Apr 12 07:51:35 user nova-compute[82850]:   </devices>
Apr 12 07:51:35 user nova-compute[82850]: </domain>
Apr 12 07:51:35 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Cannot resize image /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'migration_context' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:51:33Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG os_vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c395303-b0, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c395303-b0, col_values=(('external_ids', {'iface-id': '8c395303-b043-4eef-a6ac-e567893e6de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:b3:b8', 'vm-uuid': '40c8d6d7-d840-4417-b897-92ff8258d984'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:51:36 user nova-compute[82850]: INFO os_vif [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0')
Apr 12 07:51:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:37 user nova-compute[82850]: WARNING nova.compute.manager [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 07:51:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:39 user nova-compute[82850]: WARNING nova.compute.manager [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 40c8d6d7-d840-4417-b897-92ff8258d984 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285900.1120512, 40c8d6d7-d840-4417-b897-92ff8258d984 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] VM Resumed (Lifecycle Event)
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:51:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance rebooted successfully.
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285900.1138701, 40c8d6d7-d840-4417-b897-92ff8258d984 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:40 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] VM Started (Lifecycle Event)
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.708s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:41 user nova-compute[82850]: INFO nova.compute.manager [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Rescuing
Apr 12 07:51:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-changed-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Refreshing instance network info cache due to event network-changed-c6274ef0-ab83-498a-b9da-38ce679c28e9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Acquiring lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Acquired lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Refreshing network info cache for port c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updated VIF entry in instance network info cache for port c6274ef0-ab83-498a-b9da-38ce679c28e9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating instance_info_cache with network_info: [{"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Releasing lock "refresh_cache-b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-changed-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Refreshing instance network info cache due to event network-changed-f210361f-81f5-484d-b3a5-12fed9c8bb8b. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Acquiring lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Acquired lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Refreshing network info cache for port f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:43 user nova-compute[82850]: INFO nova.compute.manager [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Terminating instance
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance destroyed successfully.
Apr 12 07:51:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Attempting a stable device rescue
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:51:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Creating image(s)
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-unplugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] No waiting events found dispatching network-vif-unplugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-unplugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "90ae9eea9559400f964a68521d7b7b5b20d34681" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "90ae9eea9559400f964a68521d7b7b5b20d34681" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updated VIF entry in instance network info cache for port f210361f-81f5-484d-b3a5-12fed9c8bb8b. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:51:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating instance_info_cache with network_info: [{"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Releasing lock "refresh_cache-53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:44 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Instance destroyed successfully.
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1609383368',display_name='tempest-TestVolumeBootPattern-server-1609383368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1609383368',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-anofh05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:04Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "address": "fa:16:3e:c5:84:18", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210361f-81", "ovs_interfaceid": "f210361f-81f5-484d-b3a5-12fed9c8bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_vif [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf210361f-81, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:44 user nova-compute[82850]: INFO os_vif [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:84:18,bridge_name='br-int',has_traffic_filtering=True,id=f210361f-81f5-484d-b3a5-12fed9c8bb8b,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210361f-81')
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:44 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4bfc6-360c-4a9c-aa63-d1cd06de1f18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:51:44 user nova-compute[82850]: No targets found.
Apr 12 07:51:44 user nova-compute[82850]: iSNS:
Apr 12 07:51:44 user nova-compute[82850]: No targets found.
Apr 12 07:51:44 user nova-compute[82850]: STATIC:
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:51:44 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:51:44 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:51:44 user nova-compute[82850]: FIRMWARE:
Apr 12 07:51:44 user nova-compute[82850]: No targets found.
Apr 12 07:51:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:51:44 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:51:44 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.part --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.virt.images [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 4304706f-f7d3-409e-81f4-fdaa40d4668a was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.part /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12367d84-1f8a-434f-87e6-9b5bb4cb6121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12fddc3-5c9a-41d5-8c0d-f91decf7d07a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)
Apr 12 07:51:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951e48dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a03319-e304-4a3a-b289-fda1e4dcadba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.077s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab959e40-6379-4b0d-80e3-7cd5cd2132bc]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef943d6-e0ac-46aa-ae53-2ddf07c57f80]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:51:44 user nova-compute[82850]: INFO nova.compute.manager [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Unrescuing
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:44 user nova-compute[82850]: INFO nova.compute.manager [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attaching volume a3a46a19-ea59-4eab-b25d-491154ae8e1e to /dev/vdb
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:44 user nova-compute[82850]: WARNING nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state rescuing.
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:44 user nova-compute[82850]: WARNING nova.compute.manager [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state rescuing.
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.101s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621667d-2f51-4319-baad-43238bae6993]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.utils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.part /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.converted" returned: 0 in 0.355s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6af3a-21bb-435a-83af-754492aea094]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5173219-a1bf-4225-9ffe-5a7948d1263f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8555435-2df6-488c-afde-0059dbb43c5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06af70-a010-4952-b529-372be2f7e9e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55753cec-9eab-437e-8779-26c885e6788c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d0840-342c-42be-ae2b-69b4ae85d753]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]
Apr 12 07:51:45 user nova-compute[82850]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:51:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "90ae9eea9559400f964a68521d7b7b5b20d34681" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "90ae9eea9559400f964a68521d7b7b5b20d34681" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "90ae9eea9559400f964a68521d7b7b5b20d34681" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:45 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d56b0d4-06c8-4b28-986b-e71477071837]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.utils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating existing volume attachment record: 10b8c6ac-0085-46af-b704-70639b533420 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d3cb3-895f-417e-8a64-d53bde876db2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.642s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (643ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:51:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Deleting instance files /opt/stack/data/nova/instances/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb_del
Apr 12 07:51:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Deletion of /opt/stack/data/nova/instances/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb_del complete
Apr 12 07:51:45 user nova-compute[82850]: INFO nova.compute.manager [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Took 2.14 seconds to destroy the instance on the hypervisor.
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681 --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681,backing_fmt=raw /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681,backing_fmt=raw /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue" returned: 0 in 0.072s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "90ae9eea9559400f964a68521d7b7b5b20d34681" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'migration_context' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start _get_guest_xml network_info=[{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:21:4a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4304706f-f7d3-409e-81f4-fdaa40d4668a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '4f136818-14e2-4d2e-81db-cb32a3ecd497', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9813c06-7a70-4358-8070-a77e87f88b30', 'serial': 'b9813c06-7a70-4358-8070-a77e87f88b30'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '01303d7c-ba7a-4127-aa02-e6887c4e1034', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:45 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0940e-f3ad-4464-90ba-d7b8e3cebdbd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rQXWwIeR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 07:51:45 user nova-compute[82850]: node.name = iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:51:45 user nova-compute[82850]: node.tpgt = -1
Apr 12 07:51:45 user nova-compute[82850]: node.startup = automatic
Apr 12 07:51:45 user nova-compute[82850]: node.leading_login = No
Apr 12 07:51:45 user nova-compute[82850]: iface.iscsi_ifacename = default
Apr 12 07:51:45 user nova-compute[82850]: iface.net_ifacename = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.ipaddress = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.prefix_len = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.hwaddress = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.transport_name = tcp
Apr 12 07:51:45 user nova-compute[82850]: iface.initiatorname = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.vlan_id = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.vlan_priority = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.vlan_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.iface_num = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.mtu = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.port = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.bootproto = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.subnet_mask = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.gateway = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_alt_client_id = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_dns = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_learn_iqn = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_vendor_id_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_vendor_id = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.dhcp_slp_da = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.fragmentation = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.gratuitous_arp = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.incoming_forwarding = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.tos_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.tos = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.ttl = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.delayed_ack = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.tcp_nagle = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.tcp_wsf_state = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.tcp_wsf = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.tcp_timer_scale = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.tcp_timestamp = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.redirect = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.def_task_mgmt_timeout = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.header_digest = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.data_digest = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.immediate_data = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.initial_r2t = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.data_seq_inorder = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.data_pdu_inorder = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.erl = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.max_receive_data_len = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.first_burst_len = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.max_outstanding_r2t = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.max_burst_len = 0
Apr 12 07:51:45 user nova-compute[82850]: iface.chap_auth = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.bidi_chap = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.strict_login_compliance = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.discovery_auth = <empty>
Apr 12 07:51:45 user nova-compute[82850]: iface.discovery_logout = <empty>
Apr 12 07:51:45 user nova-compute[82850]: node.discovery_address = <empty>
Apr 12 07:51:45 user nova-compute[82850]: node.discovery_port = 0
Apr 12 07:51:45 user nova-compute[82850]: node.discovery_type = static
Apr 12 07:51:45 user nova-compute[82850]: node.session.initial_cmdsn = 0
Apr 12 07:51:45 user nova-compute[82850]: node.session.initial_login_retry_max = 8
Apr 12 07:51:45 user nova-compute[82850]: node.session.xmit_thread_priority = -20
Apr 12 07:51:45 user nova-compute[82850]: node.session.cmds_max = 128
Apr 12 07:51:45 user nova-compute[82850]: node.session.queue_depth = 32
Apr 12 07:51:45 user nova-compute[82850]: node.session.nr_sessions = 1
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.authmethod = CHAP
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.username = rQXWwIeR
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.password = ***
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.username_in = <empty>
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.password_in = <empty>
Apr 12 07:51:45 user nova-compute[82850]: node.session.auth.chap_algs = MD5
Apr 12 07:51:45 user nova-compute[82850]: node.session.timeo.replacement_timeout = 120
Apr 12 07:51:45 user nova-compute[82850]: node.session.err_timeo.abort_timeout = 15
Apr 12 07:51:45 user nova-compute[82850]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 07:51:45 user nova-compute[82850]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 07:51:45 user nova-compute[82850]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.FastAbort = Yes
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.InitialR2T = No
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.ImmediateData = Yes
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.MaxConnections = 1
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 07:51:45 user nova-compute[82850]: node.session.iscsi.ERL = 0
Apr 12 07:51:45 user nova-compute[82850]: node.session.scan = manual
Apr 12 07:51:45 user nova-compute[82850]: node.session.reopen_max = 0
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].address = 172.16.0.220
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].port = 3260
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].startup = manual
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].tcp.window_size = 524288
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].tcp.type_of_service = 0
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].timeo.logout_timeout = 15
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].timeo.login_timeout = 15
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].timeo.auth_timeout = 45
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.DataDigest = None
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.IFMarker = No
Apr 12 07:51:45 user nova-compute[82850]: node.conn[0].iscsi.OFMarker = No
Apr 12 07:51:45 user nova-compute[82850]: # END RECORD
Apr 12 07:51:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1ac37-1565-4284-9748-dddf6dd6b939]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea27b1e-2e7a-4bf7-9f1c-52de1c0dd4a0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQXWwIeR {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQXWwIeR" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9480359-ad38-40b7-9acd-7aba98383cbb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQXWwIeR'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Acquiring lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] No waiting events found dispatching network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:45 user nova-compute[82850]: WARNING nova.compute.manager [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received unexpected event network-vif-plugged-f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance with vm_state active and task_state deleting.
Apr 12 07:51:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bdd245-5390-4acc-b26e-f29a98a812b0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[513942e7-3fcc-4210-a5d5-ca3ab650bfb1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92f39b5-0d3b-45c4-9e18-6049dd8eec81 (non-flash)
Apr 12 07:51:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HCTL ('36', '0', '0', 0) found on session 32 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8df89b-51a7-4d01-ab8b-69d1cf69c91c]: (4, ('0 0 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Searching for a device in session 32 and hctl ('36', '0', '0', 0) yield: sde {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== connect_volume: return (230ms) {'type': 'block', 'scsi_wwn': '26233356464666262', 'path': '/dev/sde'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233356464666262', 'path': '/dev/sde'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-216955781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-216955781',id=27,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-g149p1ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:50:09Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=4f136818-14e2-4d2e-81db-cb32a3ecd497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:21:4a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:21:4a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:51:45 user nova-compute[82850]:   <uuid>4f136818-14e2-4d2e-81db-cb32a3ecd497</uuid>
Apr 12 07:51:45 user nova-compute[82850]:   <name>instance-0000001b</name>
Apr 12 07:51:45 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:51:45 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:51:45 user nova-compute[82850]:   <metadata>
Apr 12 07:51:45 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:51:45 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-216955781</nova:name>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:51:45</nova:creationTime>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:51:45 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:51:45 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:owner>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 07:51:45 user nova-compute[82850]:       </nova:owner>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:51:45 user nova-compute[82850]:       <nova:ports>
Apr 12 07:51:45 user nova-compute[82850]:         <nova:port uuid="8eee7860-e187-49d6-8595-784114b9fb4f">
Apr 12 07:51:45 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:51:45 user nova-compute[82850]:         </nova:port>
Apr 12 07:51:45 user nova-compute[82850]:       </nova:ports>
Apr 12 07:51:45 user nova-compute[82850]:     </nova:instance>
Apr 12 07:51:45 user nova-compute[82850]:   </metadata>
Apr 12 07:51:45 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:51:45 user nova-compute[82850]:     <system>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="serial">4f136818-14e2-4d2e-81db-cb32a3ecd497</entry>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="uuid">4f136818-14e2-4d2e-81db-cb32a3ecd497</entry>
Apr 12 07:51:45 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:51:45 user nova-compute[82850]:     </system>
Apr 12 07:51:45 user nova-compute[82850]:   </sysinfo>
Apr 12 07:51:45 user nova-compute[82850]:   <os>
Apr 12 07:51:45 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:51:45 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:51:45 user nova-compute[82850]:   </os>
Apr 12 07:51:45 user nova-compute[82850]:   <features>
Apr 12 07:51:45 user nova-compute[82850]:     <acpi/>
Apr 12 07:51:45 user nova-compute[82850]:     <apic/>
Apr 12 07:51:45 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:51:45 user nova-compute[82850]:   </features>
Apr 12 07:51:45 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:51:45 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:51:45 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:51:45 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:51:45 user nova-compute[82850]:   </clock>
Apr 12 07:51:45 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:51:45 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:51:45 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:51:45 user nova-compute[82850]:   </cpu>
Apr 12 07:51:45 user nova-compute[82850]:   <devices>
Apr 12 07:51:45 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:51:45 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:51:45 user nova-compute[82850]:       <source dev="/dev/sde"/>
Apr 12 07:51:45 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:51:45 user nova-compute[82850]:       <serial>b9813c06-7a70-4358-8070-a77e87f88b30</serial>
Apr 12 07:51:45 user nova-compute[82850]:     </disk>
Apr 12 07:51:45 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:51:45 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:51:45 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue"/>
Apr 12 07:51:45 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 07:51:45 user nova-compute[82850]:       <boot order="1"/>
Apr 12 07:51:45 user nova-compute[82850]:     </disk>
Apr 12 07:51:45 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:51:45 user nova-compute[82850]:       <mac address="fa:16:3e:21:4a:a9"/>
Apr 12 07:51:45 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:51:45 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:51:45 user nova-compute[82850]:       <target dev="tap8eee7860-e1"/>
Apr 12 07:51:45 user nova-compute[82850]:     </interface>
Apr 12 07:51:45 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:51:45 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/console.log" append="off"/>
Apr 12 07:51:45 user nova-compute[82850]:     </serial>
Apr 12 07:51:45 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:51:45 user nova-compute[82850]:     <video>
Apr 12 07:51:45 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:51:45 user nova-compute[82850]:     </video>
Apr 12 07:51:45 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:51:45 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:51:45 user nova-compute[82850]:     </rng>
Apr 12 07:51:45 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:51:45 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:51:45 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:51:45 user nova-compute[82850]:     </memballoon>
Apr 12 07:51:45 user nova-compute[82850]:   </devices>
Apr 12 07:51:45 user nova-compute[82850]: </domain>
Apr 12 07:51:45 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:51:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance destroyed successfully.
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:21:4a:a9, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Received event network-vif-deleted-f210361f-81f5-484d-b3a5-12fed9c8bb8b {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:46 user nova-compute[82850]: INFO nova.compute.manager [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Neutron deleted interface f210361f-81f5-484d-b3a5-12fed9c8bb8b; detaching it from the instance and deleting it from the info cache
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.network.neutron [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:51:46 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Took 1.00 seconds to deallocate network for instance.
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Detach interface failed, port_id=f210361f-81f5-484d-b3a5-12fed9c8bb8b, reason: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:46 user nova-compute[82850]: WARNING nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:46 user nova-compute[82850]: WARNING nova.compute.manager [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:51:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance destroyed successfully.
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:48 user nova-compute[82850]: WARNING nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state rescuing.
Apr 12 07:51:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:48 user nova-compute[82850]: WARNING nova.compute.manager [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state rescuing.
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:50 user nova-compute[82850]: INFO nova.compute.manager [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Took 4.76 seconds to detach 1 volumes for instance.
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:51 user nova-compute[82850]: WARNING nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:51:51 user nova-compute[82850]: WARNING nova.compute.manager [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 4f136818-14e2-4d2e-81db-cb32a3ecd497 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285911.0487502, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Resumed (Lifecycle Event)
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285911.0501425, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Started (Lifecycle Event)
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVwgxYnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:51:51 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc753af-e029-470d-81c3-745ee32fa068]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:51:51 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd16a1-376e-483d-9092-64c7e18ea298]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e] added
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cae24a-c7cc-4a91-ae2d-d81c3e475e18]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f99e30b-3050-4cff-acd1-ab988f6a8a3e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVwgxYnU {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVwgxYnU" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[606ddba3-b150-4cf8-8f19-15279bcbb378]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVwgxYnU'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[483b6b1b-c998-4e50-be9f-cf544c040c92]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c7282a-1611-4e60-97b8-57beb4fd05f9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fbf80-523b-457d-90fb-e6c8e91e1258]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260]
Apr 12 07:51:51 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260] successful.
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285911.5858662, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Resumed (Lifecycle Event)
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d1103-1a72-4386-a54a-fa103b52c7aa]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e6040e-4add-45ce-9463-87e88c08a809]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:51:51 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:51:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285911.59023, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Started (Lifecycle Event)
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2e747-14ea-4e40-b4b3-3842617cc99c]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVwgxYnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.649s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23966316236353234', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966316236353234', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:51:52 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:51:52 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:51:52 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:51:52 user nova-compute[82850]:   <serial>a3a46a19-ea59-4eab-b25d-491154ae8e1e</serial>
Apr 12 07:51:52 user nova-compute[82850]: </disk>
Apr 12 07:51:52 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:51:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:51:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No VIF found with MAC fa:16:3e:ca:b3:de, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:51:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.662s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:51:56 user nova-compute[82850]: INFO nova.compute.manager [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attaching volume c4744ab9-f48a-40e8-8003-d614815a6f12 to /dev/vdc
Apr 12 07:51:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG os_brick.utils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[691da398-be02-4f3f-9296-b33e106b366a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e669fe-3bc4-4971-8d4e-61d015c71162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e622b6-e1f5-4616-86cc-827dda5cef6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15af5cf-cfb9-4cf0-9593-2332314fcc8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:51:56 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:51:56 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be42a04-7fe4-40a1-9547-6c815b173a87]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:51:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:51:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:51:57 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:51:57 user nova-compute[82850]: DEBUG os_brick.utils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:51:57 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating existing volume attachment record: e05cc124-62fc-4724-bf60-882dedfea9d4 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:51:59 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285903.8466167, 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:51:59 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] VM Stopped (Lifecycle Event)
Apr 12 07:51:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-90d62de1-999f-41be-be2c-f93e609e51a1 None None] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:51:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIFepydB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:01 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:01 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:01 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4294d0e-8a59-433c-95f2-2048a9e47b49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:52:01 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d389d671-8990-43f0-a026-b58badc97171]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12] added
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8862e-03a4-4a77-a7fc-3bf500d7a700]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a55456-91f6-4296-aa7f-c7039693049a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIFepydB {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIFepydB" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d9571-e573-429e-9e28-4936d63b0850]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZIFepydB'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01844b99-5519-43d7-aff8-28dc5401afa7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ceb524-5848-4146-bf3a-a86913332859]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30657943-c9b7-4038-b6dc-6d5a3b6d1de0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260]
Apr 12 07:52:01 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d1b6c-bcca-4139-a089-15ffb07722c0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c389b5bb-2ada-4e0c-be01-dca56f8b7873]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:01 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:01 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526cb05-fd05-4803-8515-87b722aba5cf]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:52:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIFepydB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:52:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:02 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26331333465313766', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331333465313766', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:52:02 user nova-compute[82850]: DEBUG nova.objects.instance [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:52:02 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:02 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:02 user nova-compute[82850]:   <target dev="vdc" bus="virtio"/>
Apr 12 07:52:02 user nova-compute[82850]:   <serial>c4744ab9-f48a-40e8-8003-d614815a6f12</serial>
Apr 12 07:52:02 user nova-compute[82850]: </disk>
Apr 12 07:52:02 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:52:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] No VIF found with MAC fa:16:3e:ca:b3:de, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:52:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.692s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:04 user nova-compute[82850]: INFO nova.compute.manager [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Detaching volume a3a46a19-ea59-4eab-b25d-491154ae8e1e
Apr 12 07:52:04 user nova-compute[82850]: INFO nova.virt.block_device [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attempting to driver detach volume a3a46a19-ea59-4eab-b25d-491154ae8e1e from mountpoint /dev/vdb
Apr 12 07:52:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Attempting to detach device vdb from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:52:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:04 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:04 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:52:04 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:52:04 user nova-compute[82850]:   <serial>a3a46a19-ea59-4eab-b25d-491154ae8e1e</serial>
Apr 12 07:52:04 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:52:04 user nova-compute[82850]: </disk>
Apr 12 07:52:04 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:04 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdb from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the persistent domain config.
Apr 12 07:52:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:52:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:04 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:04 user nova-compute[82850]:   <source dev="/dev/sdc"/>
Apr 12 07:52:04 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:52:04 user nova-compute[82850]:   <serial>a3a46a19-ea59-4eab-b25d-491154ae8e1e</serial>
Apr 12 07:52:04 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:52:04 user nova-compute[82850]: </disk>
Apr 12 07:52:04 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285925.388245, b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:52:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdb from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the live domain config.
Apr 12 07:52:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVwgxYnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:05 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307a5bc-50f7-447e-8fc5-6945c4fad958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:52:05 user nova-compute[82850]: No targets found.
Apr 12 07:52:05 user nova-compute[82850]: iSNS:
Apr 12 07:52:05 user nova-compute[82850]: No targets found.
Apr 12 07:52:05 user nova-compute[82850]: STATIC:
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:52:05 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:05 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:05 user nova-compute[82850]: FIRMWARE:
Apr 12 07:52:05 user nova-compute[82850]: No targets found.
Apr 12 07:52:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:52:05 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:52:05 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c10c0f-4fce-4c1e-a5f4-797bb5380272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ecbfeb-fa7b-4876-8d6e-74adac6d8473]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e (non-flash)
Apr 12 07:52:05 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f193420c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211171d-0de7-43d8-a488-0cce84e9573a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b0e56-df0d-4ba0-857f-46b4524d45be]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a39b9-c036-4a9c-af19-d7e459b75ded]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64a117-cd0d-4fa0-9b58-0cd96962f41e]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61dad91-a675-42fe-ba3a-153f106f73d6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90dd00-62fc-49a9-86c2-2bcbd6b63813]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260]
Apr 12 07:52:05 user nova-compute[82850]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:05 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a46a19-ea59-4eab-b25d-491154ae8e1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf75df0b-d307-40db-b393-1f2db8120b76]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== disconnect_volume: return (336ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:52:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.742s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:07 user nova-compute[82850]: INFO nova.compute.manager [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Detaching volume c4744ab9-f48a-40e8-8003-d614815a6f12
Apr 12 07:52:07 user nova-compute[82850]: INFO nova.virt.block_device [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Attempting to driver detach volume c4744ab9-f48a-40e8-8003-d614815a6f12 from mountpoint /dev/vdc
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Attempting to detach device vdc from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:07 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:07 user nova-compute[82850]:   <target dev="vdc" bus="virtio"/>
Apr 12 07:52:07 user nova-compute[82850]:   <serial>c4744ab9-f48a-40e8-8003-d614815a6f12</serial>
Apr 12 07:52:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 07:52:07 user nova-compute[82850]: </disk>
Apr 12 07:52:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdc from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the persistent domain config.
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:07 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:07 user nova-compute[82850]:   <target dev="vdc" bus="virtio"/>
Apr 12 07:52:07 user nova-compute[82850]:   <serial>c4744ab9-f48a-40e8-8003-d614815a6f12</serial>
Apr 12 07:52:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 07:52:07 user nova-compute[82850]: </disk>
Apr 12 07:52:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285927.6866937, b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:52:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully detached device vdc from instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d from the live domain config.
Apr 12 07:52:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIFepydB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3464f1-52f4-495f-bfd8-924598459d37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:52:07 user nova-compute[82850]: No targets found.
Apr 12 07:52:07 user nova-compute[82850]: iSNS:
Apr 12 07:52:07 user nova-compute[82850]: No targets found.
Apr 12 07:52:07 user nova-compute[82850]: STATIC:
Apr 12 07:52:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:52:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:52:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:52:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12
Apr 12 07:52:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:52:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:07 user nova-compute[82850]: FIRMWARE:
Apr 12 07:52:07 user nova-compute[82850]: No targets found.
Apr 12 07:52:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:52:07 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:52:07 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f50df-00f1-4f1b-8da5-b1d195ec2bef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b7c28-4349-4478-9aba-cb219b44a347]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 (non-flash)
Apr 12 07:52:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194eca9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1167f3d-abe8-4a29-84c4-f37c4a8f6e3e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf06f3-7666-4262-80c6-475764fa491e]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032fa22-00fb-4532-9986-ef5b0ca7944d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[930942ab-f6a7-478f-afe0-79aaf3dd466e]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e92cb5-99c4-4347-bd27-5f8e81f075b4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[458af8cf-d4c1-4696-9917-7e3009814069]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260]
Apr 12 07:52:07 user nova-compute[82850]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4744ab9-f48a-40e8-8003-d614815a6f12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fe5c0-cff2-4e80-a4bb-f9838247d273]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] <== disconnect_volume: return (315ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'flavor' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.754s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:09 user nova-compute[82850]: INFO nova.compute.manager [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Terminating instance
Apr 12 07:52:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-unplugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] No waiting events found dispatching network-vif-unplugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-unplugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:52:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Instance destroyed successfully.
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'resources' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671601953',display_name='tempest-AttachVolumeTestJSON-server-671601953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671601953',id=26,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCedAa62t7wTvsMMaws5FD+HUmLenb3mQ4AwNRmz+5NlHwSxx+o2cxbVwQovpHZ/OrawGaz4PYDTmPhVUwUu7H+S0t7XDeKFrnIndqQ1jSYYzsPhBvnJ2fPVpdw6VG97eQ==',key_name='tempest-keypair-10133080',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7915d29fb124c838093eba0ee6cb69c',ramdisk_id='',reservation_id='r-4m0ayyyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1353175840',owner_user_name='tempest-AttachVolumeTestJSON-1353175840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a555fa5e6680420e80fcc925a7540806',uuid=b36f9b90-b2e0-4b08-8ff1-8ce3994e149d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converting VIF {"id": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "address": "fa:16:3e:ca:b3:de", "network": {"id": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-978432671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7915d29fb124c838093eba0ee6cb69c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6274ef0-ab", "ovs_interfaceid": "c6274ef0-ab83-498a-b9da-38ce679c28e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG os_vif [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6274ef0-ab, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:52:10 user nova-compute[82850]: INFO os_vif [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:b3:de,bridge_name='br-int',has_traffic_filtering=True,id=c6274ef0-ab83-498a-b9da-38ce679c28e9,network=Network(7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6274ef0-ab')
Apr 12 07:52:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Deleting instance files /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d_del
Apr 12 07:52:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Deletion of /opt/stack/data/nova/instances/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d_del complete
Apr 12 07:52:10 user nova-compute[82850]: INFO nova.compute.manager [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 07:52:10 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:52:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:11 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Took 0.81 seconds to deallocate network for instance.
Apr 12 07:52:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-deleted-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:52:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:11 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Deleted allocations for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d
Apr 12 07:52:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Acquiring lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Lock "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] No waiting events found dispatching network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:12 user nova-compute[82850]: WARNING nova.compute.manager [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Received unexpected event network-vif-plugged-c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance with vm_state deleted and task_state None.
Apr 12 07:52:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:21 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:52:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:52:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:52:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:52:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285930.6065967, b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:52:25 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] VM Stopped (Lifecycle Event)
Apr 12 07:52:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a7d3b271-29d8-4d36-95c4-679965bb597a None None] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:52:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:52:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=26.10413360595703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3b7424e4-52aa-4330-a748-006240372716 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 40c8d6d7-d840-4417-b897-92ff8258d984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c33e7825-1766-472a-8f09-c17a239fe63b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:52:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:52:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:52:34 user nova-compute[82850]: INFO nova.compute.claims [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Claim successful on node user
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:52:35 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:52:35 user nova-compute[82850]: INFO nova.virt.block_device [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Booting with volume fe954cd5-982e-420d-b3e2-6da8bff98d9f at /dev/vda
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.policy [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.utils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd6ee09-ce21-4962-8d8e-706d43f9feed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712fe92-1487-42ce-9ce7-b1db26298e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[def0b851-0d1e-4cd8-859a-7bd169e6f1d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[230957b5-e6c8-4b6c-9146-2197d9f3c690]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:52:35 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:52:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1955127a-0313-4251-bde2-e3fe77cb4573]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG os_brick.utils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating existing volume attachment record: c0d7639d-1a5f-41b5-b7b2-32de66869c0e {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:52:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Successfully created port: 7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Ignoring supplied device name: /dev/vdb
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Successfully updated port: 7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing instance network info cache due to event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Acquiring lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:37 user nova-compute[82850]: INFO nova.compute.manager [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Attaching volume 44a5f2d9-dda3-4068-a009-8966651e4275 to /dev/vdb
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.utils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating instance_info_cache with network_info: [{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911ae23-57cf-4986-b03d-d36d25d02a37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3ad8e-76a9-4b0d-a208-3946e92845f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Instance network_info: |[{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Acquired lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.network.neutron [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f8b0c-aa9c-4fe8-ae99-9d09297500cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cac192-f7c9-4788-8a9c-3e699feaaf35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:52:37 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:52:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3183b73e-9b3e-4569-8b23-5e5a9ad24d99]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG os_brick.utils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:37 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updating existing volume attachment record: 4bc49d41-90f5-4666-b913-f4dbf21e9319 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:52:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updated VIF entry in instance network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:52:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating instance_info_cache with network_info: [{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Releasing lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:52:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:52:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Creating image(s)
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Ensure instance console log exists: /opt/stack/data/nova/instances/6f8d2d38-c98a-45d2-8829-e95e7cac030e/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Start _get_guest_xml network_info=[{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f8d2d38-c98a-45d2-8829-e95e7cac030e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'serial': 'fe954cd5-982e-420d-b3e2-6da8bff98d9f'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'c0d7639d-1a5f-41b5-b7b2-32de66869c0e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:52:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:52:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:42 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:42 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:42 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2e9cc-c7a3-4788-9c52-34f99db83b1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:52:42 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5cb71e-1483-4bc6-bc2c-172500803def]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f] added
Apr 12 07:52:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771f0c3-1d66-468f-b77b-45c2a656342d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434f9ae-b89e-4905-b329-9bb89504975d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQkbYjeV {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQkbYjeV" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae049c63-8832-4f1c-84ed-0fd9fdd16962]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQkbYjeV'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06315ddc-7886-4962-8ef5-91114b482561]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb1c98-0588-4107-877a-acdb45e210c8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d52d2-4113-4bb3-be70-520ca7f15e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]
Apr 12 07:52:42 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d6d360-88c9-437d-be1c-3bc7f48f1e17]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[123e8181-0a3a-43ba-a837-c04d151f5e76]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:43 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:43 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:43 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3fa3ae-60c6-4c72-a04d-ecfa6f805f9c]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZfNaDji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:43 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26366643132653666', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366643132653666', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.269s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:44 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:44 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca5e57-85f3-4c7b-af56-d5c7585a5188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:52:44 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526182795',display_name='tempest-TestVolumeBootPattern-server-526182795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526182795',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ss3wj0oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:52:35Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=6f8d2d38-c98a-45d2-8829-e95e7cac030e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f8d2d38-c98a-45d2-8829-e95e7cac030e {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:52:44 user nova-compute[82850]:   <uuid>6f8d2d38-c98a-45d2-8829-e95e7cac030e</uuid>
Apr 12 07:52:44 user nova-compute[82850]:   <name>instance-0000001d</name>
Apr 12 07:52:44 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:52:44 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:52:44 user nova-compute[82850]:   <metadata>
Apr 12 07:52:44 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:52:44 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:52:44 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-server-526182795</nova:name>
Apr 12 07:52:44 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:52:42</nova:creationTime>
Apr 12 07:52:44 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:52:44 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:52:44 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:52:44 user nova-compute[82850]:       <nova:owner>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:52:44 user nova-compute[82850]:       </nova:owner>
Apr 12 07:52:44 user nova-compute[82850]:       <nova:ports>
Apr 12 07:52:44 user nova-compute[82850]:         <nova:port uuid="7406406c-e3a5-4cf8-9cd4-3352be7a2f09">
Apr 12 07:52:44 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 07:52:44 user nova-compute[82850]:         </nova:port>
Apr 12 07:52:44 user nova-compute[82850]:       </nova:ports>
Apr 12 07:52:44 user nova-compute[82850]:     </nova:instance>
Apr 12 07:52:44 user nova-compute[82850]:   </metadata>
Apr 12 07:52:44 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:52:44 user nova-compute[82850]:     <system>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="serial">6f8d2d38-c98a-45d2-8829-e95e7cac030e</entry>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="uuid">6f8d2d38-c98a-45d2-8829-e95e7cac030e</entry>
Apr 12 07:52:44 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:52:44 user nova-compute[82850]:     </system>
Apr 12 07:52:44 user nova-compute[82850]:   </sysinfo>
Apr 12 07:52:44 user nova-compute[82850]:   <os>
Apr 12 07:52:44 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:52:44 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:52:44 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:52:44 user nova-compute[82850]:   </os>
Apr 12 07:52:44 user nova-compute[82850]:   <features>
Apr 12 07:52:44 user nova-compute[82850]:     <acpi/>
Apr 12 07:52:44 user nova-compute[82850]:     <apic/>
Apr 12 07:52:44 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:52:44 user nova-compute[82850]:   </features>
Apr 12 07:52:44 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:52:44 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:52:44 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:52:44 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:52:44 user nova-compute[82850]:   </clock>
Apr 12 07:52:44 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:52:44 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:52:44 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:52:44 user nova-compute[82850]:   </cpu>
Apr 12 07:52:44 user nova-compute[82850]:   <devices>
Apr 12 07:52:44 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:52:44 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:44 user nova-compute[82850]:       <source dev="/dev/sdc"/>
Apr 12 07:52:44 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:52:44 user nova-compute[82850]:       <serial>fe954cd5-982e-420d-b3e2-6da8bff98d9f</serial>
Apr 12 07:52:44 user nova-compute[82850]:     </disk>
Apr 12 07:52:44 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:52:44 user nova-compute[82850]:       <mac address="fa:16:3e:54:c4:1d"/>
Apr 12 07:52:44 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:52:44 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:52:44 user nova-compute[82850]:       <target dev="tap7406406c-e3"/>
Apr 12 07:52:44 user nova-compute[82850]:     </interface>
Apr 12 07:52:44 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:52:44 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/6f8d2d38-c98a-45d2-8829-e95e7cac030e/console.log" append="off"/>
Apr 12 07:52:44 user nova-compute[82850]:     </serial>
Apr 12 07:52:44 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:52:44 user nova-compute[82850]:     <video>
Apr 12 07:52:44 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:52:44 user nova-compute[82850]:     </video>
Apr 12 07:52:44 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:52:44 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:52:44 user nova-compute[82850]:     </rng>
Apr 12 07:52:44 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:52:44 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:52:44 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:52:44 user nova-compute[82850]:     </memballoon>
Apr 12 07:52:44 user nova-compute[82850]:   </devices>
Apr 12 07:52:44 user nova-compute[82850]: </domain>
Apr 12 07:52:44 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526182795',display_name='tempest-TestVolumeBootPattern-server-526182795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526182795',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ss3wj0oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:52:35Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=6f8d2d38-c98a-45d2-8829-e95e7cac030e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_vif [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84ce87-1ab0-4fa9-87a1-d04ec0c0d93c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275] added
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7406406c-e3, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7406406c-e3, col_values=(('external_ids', {'iface-id': '7406406c-e3a5-4cf8-9cd4-3352be7a2f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c4:1d', 'vm-uuid': '6f8d2d38-c98a-45d2-8829-e95e7cac030e'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:44 user nova-compute[82850]: INFO os_vif [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3')
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc9f94-7f71-4091-ac11-84b09144fd64]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.099s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15240fa-076f-457f-b7ab-c019e9ad770d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZfNaDji {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:54:c4:1d, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZfNaDji" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e303cd-78bd-42f1-9130-4fdef1fd0822]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZfNaDji'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e063f7c1-2f5d-417c-a594-311f8882255b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddb3346-880f-4508-9039-3a387ca16495]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaedb528-6ff9-4c4e-9079-dd10cf4ac120]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260]
Apr 12 07:52:44 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[077dfd59-c6d6-4609-bef0-a8c4e1db249d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265926c-b7f9-4262-b977-de1eaed82fd5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:44 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:44 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b44bc5-f530-4d68-b163-067ca7f760a5]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:52:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZfNaDji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== connect_volume: return (1728ms) {'type': 'block', 'scsi_wwn': '26137613132316638', 'path': '/dev/sdg'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137613132316638', 'path': '/dev/sdg'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:52:45 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:45 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:45 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:52:45 user nova-compute[82850]:   <serial>44a5f2d9-dda3-4068-a009-8966651e4275</serial>
Apr 12 07:52:45 user nova-compute[82850]: </disk>
Apr 12 07:52:45 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] No waiting events found dispatching network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:45 user nova-compute[82850]: WARNING nova.compute.manager [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received unexpected event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance with vm_state building and task_state spawning.
Apr 12 07:52:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:52:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] No VIF found with MAC fa:16:3e:f6:d4:5b, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:52:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.626s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] No waiting events found dispatching network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:47 user nova-compute[82850]: WARNING nova.compute.manager [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received unexpected event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance with vm_state building and task_state spawning.
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285968.0366125, 6f8d2d38-c98a-45d2-8829-e95e7cac030e => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] VM Resumed (Lifecycle Event)
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Instance spawned successfully.
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681285968.0368018, 6f8d2d38-c98a-45d2-8829-e95e7cac030e => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] VM Started (Lifecycle Event)
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:52:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:52:48 user nova-compute[82850]: INFO nova.compute.manager [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Took 13.29 seconds to build instance.
Apr 12 07:52:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.396s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:53 user nova-compute[82850]: INFO nova.compute.manager [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Terminating instance
Apr 12 07:52:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-unplugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:52:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Instance destroyed successfully.
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2004380288',display_name='tempest-ServerActionsTestJSON-server-926530387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2004380288',id=4,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-8to6k1ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=3b7424e4-52aa-4330-a748-006240372716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "d24db70b-543b-4549-8c33-b8276a776c3d", "address": "fa:16:3e:d5:f3:b1", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24db70b-54", "ovs_interfaceid": "d24db70b-543b-4549-8c33-b8276a776c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_vif [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24db70b-54, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:52:54 user nova-compute[82850]: INFO os_vif [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:b1,bridge_name='br-int',has_traffic_filtering=True,id=d24db70b-543b-4549-8c33-b8276a776c3d,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24db70b-54')
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHQspbel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:54 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb0b189-71d9-4004-8309-4450395ef1b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:52:54 user nova-compute[82850]: No targets found.
Apr 12 07:52:54 user nova-compute[82850]: iSNS:
Apr 12 07:52:54 user nova-compute[82850]: No targets found.
Apr 12 07:52:54 user nova-compute[82850]: STATIC:
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:52:54 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:54 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:54 user nova-compute[82850]: FIRMWARE:
Apr 12 07:52:54 user nova-compute[82850]: No targets found.
Apr 12 07:52:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:52:54 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:52:54 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b4603-5d36-46a8-912e-73bae2318b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94759bc0-8e89-45d2-a896-89da04521701]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:54 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194419f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f6aba5-87f3-4d67-ad1d-eadd6f579e9b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9bba7-8600-44bd-a4c2-b13fcaa686be]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85d6f0-bccd-47da-8d09-9285a199b66c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07036e21-1303-4ea5-914a-546117a50cee]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789dc60-5609-4ce1-ac17-4601fa0d9187]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4652e03-a4fc-43df-9c65-f044ebc4f50e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260]
Apr 12 07:52:54 user nova-compute[82850]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:54 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894167f3-141a-4eb7-80a6-60d5af7aada7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4447e78-0e47-4217-8abe-67ca5beadfec]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (331ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:52:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Deleting instance files /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_del
Apr 12 07:52:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Deletion of /opt/stack/data/nova/instances/3b7424e4-52aa-4330-a748-006240372716_del complete
Apr 12 07:52:54 user nova-compute[82850]: INFO nova.compute.manager [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 12 07:52:54 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:52:54 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-deleted-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:55 user nova-compute[82850]: INFO nova.compute.manager [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Neutron deleted interface d24db70b-543b-4549-8c33-b8276a776c3d; detaching it from the instance and deleting it from the info cache
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.network.neutron [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:52:55 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] Took 0.83 seconds to deallocate network for instance.
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Detach interface failed, port_id=d24db70b-543b-4549-8c33-b8276a776c3d, reason: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Acquiring lock "3b7424e4-52aa-4330-a748-006240372716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Lock "3b7424e4-52aa-4330-a748-006240372716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] No waiting events found dispatching network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:55 user nova-compute[82850]: WARNING nova.compute.manager [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] [instance: 3b7424e4-52aa-4330-a748-006240372716] Received unexpected event network-vif-plugged-d24db70b-543b-4549-8c33-b8276a776c3d for instance with vm_state active and task_state deleting.
Apr 12 07:52:56 user nova-compute[82850]: INFO nova.compute.manager [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Took 1.10 seconds to detach 1 volumes for instance.
Apr 12 07:52:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:56 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:52:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:52:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:56 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Deleted allocations for instance 3b7424e4-52aa-4330-a748-006240372716
Apr 12 07:52:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "3b7424e4-52aa-4330-a748-006240372716" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.665s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:57 user nova-compute[82850]: INFO nova.compute.manager [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Detaching volume 44a5f2d9-dda3-4068-a009-8966651e4275
Apr 12 07:52:57 user nova-compute[82850]: INFO nova.virt.block_device [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Attempting to driver detach volume 44a5f2d9-dda3-4068-a009-8966651e4275 from mountpoint /dev/vdb
Apr 12 07:52:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Attempting to detach device vdb from instance c33e7825-1766-472a-8f09-c17a239fe63b from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:52:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:57 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:57 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:57 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:52:57 user nova-compute[82850]:   <serial>44a5f2d9-dda3-4068-a009-8966651e4275</serial>
Apr 12 07:52:57 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:52:57 user nova-compute[82850]: </disk>
Apr 12 07:52:57 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:57 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully detached device vdb from instance c33e7825-1766-472a-8f09-c17a239fe63b from the persistent domain config.
Apr 12 07:52:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c33e7825-1766-472a-8f09-c17a239fe63b from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:52:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:52:57 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:52:57 user nova-compute[82850]:   <source dev="/dev/sdg"/>
Apr 12 07:52:57 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:52:57 user nova-compute[82850]:   <serial>44a5f2d9-dda3-4068-a009-8966651e4275</serial>
Apr 12 07:52:57 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:52:57 user nova-compute[82850]: </disk>
Apr 12 07:52:57 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681285978.3642654, c33e7825-1766-472a-8f09-c17a239fe63b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:52:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully detached device vdb from instance c33e7825-1766-472a-8f09-c17a239fe63b from the live domain config.
Apr 12 07:52:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZfNaDji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:52:58 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[673eb803-4390-41b8-b006-6dfb220ff1e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:52:58 user nova-compute[82850]: No targets found.
Apr 12 07:52:58 user nova-compute[82850]: iSNS:
Apr 12 07:52:58 user nova-compute[82850]: No targets found.
Apr 12 07:52:58 user nova-compute[82850]: STATIC:
Apr 12 07:52:58 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:52:58 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:58 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:58 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:52:58 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:58 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:58 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:52:58 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:58 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:58 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275
Apr 12 07:52:58 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:58 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:58 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:52:58 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:52:58 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:52:58 user nova-compute[82850]: FIRMWARE:
Apr 12 07:52:58 user nova-compute[82850]: No targets found.
Apr 12 07:52:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:52:58 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:52:58 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a9df8-0736-48cd-a0af-f93d6b2f5975]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b661574-a5e6-436a-96f4-bfb97b1a2587]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:52:58 user nova-compute[82850]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 (non-flash)
Apr 12 07:52:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0ae560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275'): ({'sdg'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Removing single pathed devices sdg {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957c1df-e5b1-4da4-9e67-df671079bdc8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dde89bc-67cf-4a48-9c49-149150fa1b54]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flushing IO for device /dev/sdg {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131090f-3de7-4f29-a87c-9c43a59bf698]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f39511-c16e-464f-8c49-aad036f3a49f]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] SCSI volumes sdg have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f794406-43da-4751-ae25-5a908e20c643]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d40c9f-5785-499e-83b8-7ced58ae33fb]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260]
Apr 12 07:52:58 user nova-compute[82850]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275, portal: 172.16.0.220,3260] successful.
Apr 12 07:52:58 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b9da5-0d4c-4ecd-9774-0f95c6290bbd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== disconnect_volume: return (313ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:52:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'flavor' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.601s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:59 user nova-compute[82850]: INFO nova.compute.manager [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Terminating instance
Apr 12 07:52:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:52:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Instance destroyed successfully.
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'resources' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-424170650',display_name='tempest-VolumesSnapshotTestJSON-instance-424170650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-424170650',id=28,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='468e9932c7634b0d8c3257ee14a66959',ramdisk_id='',reservation_id='r-a79rv8j6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1434579998',owner_user_name='tempest-VolumesSnapshotTestJSON-1434579998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:50:54Z,user_data=None,user_id='76d4eef76f634fb39c1f0895abfbd17d',uuid=c33e7825-1766-472a-8f09-c17a239fe63b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converting VIF {"id": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "address": "fa:16:3e:f6:d4:5b", "network": {"id": "a5752d9a-79d5-4f8c-877b-1aeb615c2285", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1998824961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "468e9932c7634b0d8c3257ee14a66959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5717efd2-8b", "ovs_interfaceid": "5717efd2-8b2e-42b5-bd06-baa345aab97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_vif [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5717efd2-8b, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:53:00 user nova-compute[82850]: INFO os_vif [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d4:5b,bridge_name='br-int',has_traffic_filtering=True,id=5717efd2-8b2e-42b5-bd06-baa345aab97c,network=Network(a5752d9a-79d5-4f8c-877b-1aeb615c2285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5717efd2-8b')
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZfNaDji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:53:00 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5e8d6-5d9a-4f32-a0b4-c8da07d2f403]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:53:00 user nova-compute[82850]: No targets found.
Apr 12 07:53:00 user nova-compute[82850]: iSNS:
Apr 12 07:53:00 user nova-compute[82850]: No targets found.
Apr 12 07:53:00 user nova-compute[82850]: STATIC:
Apr 12 07:53:00 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:53:00 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:00 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:00 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:53:00 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:00 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:00 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:53:00 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:00 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:00 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:53:00 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:00 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:00 user nova-compute[82850]: FIRMWARE:
Apr 12 07:53:00 user nova-compute[82850]: No targets found.
Apr 12 07:53:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:53:00 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:53:00 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a5f2d9-dda3-4068-a009-8966651e4275', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9653f58-02c1-4c08-95fd-d1d9b9b3ba90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa31bb0-5ca4-4aad-9c31-bca3c622f0b9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:53:00 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:00 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f193420e290>, {}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Disconnecting from: [] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] <== disconnect_volume: return (79ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:53:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Deleting instance files /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b_del
Apr 12 07:53:00 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Deletion of /opt/stack/data/nova/instances/c33e7825-1766-472a-8f09-c17a239fe63b_del complete
Apr 12 07:53:00 user nova-compute[82850]: INFO nova.compute.manager [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 07:53:00 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:53:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:01 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Took 0.61 seconds to deallocate network for instance.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-deleted-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: INFO nova.compute.manager [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Neutron deleted interface 5717efd2-8b2e-42b5-bd06-baa345aab97c; detaching it from the instance and deleting it from the info cache
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.network.neutron [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.volume.cinder [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Attachment 4bc49d41-90f5-4666-b913-f4dbf21e9319 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4bc49d41-90f5-4666-b913-f4dbf21e9319. (HTTP 404) (Request-ID: req-b20da972-cc68-42bc-ab8e-79d9078be25d)
Apr 12 07:53:01 user nova-compute[82850]: INFO nova.compute.manager [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Detach interface failed, port_id=5717efd2-8b2e-42b5-bd06-baa345aab97c, reason: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Deleted allocations for instance c33e7825-1766-472a-8f09-c17a239fe63b
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "c33e7825-1766-472a-8f09-c17a239fe63b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state deleted and task_state None.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state deleted and task_state None.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state deleted and task_state None.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-unplugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state deleted and task_state None.
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "c33e7825-1766-472a-8f09-c17a239fe63b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] No waiting events found dispatching network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:01 user nova-compute[82850]: WARNING nova.compute.manager [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Received unexpected event network-vif-plugged-5717efd2-8b2e-42b5-bd06-baa345aab97c for instance with vm_state deleted and task_state None.
Apr 12 07:53:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:09 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285974.089896, 3b7424e4-52aa-4330-a748-006240372716 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:09 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 3b7424e4-52aa-4330-a748-006240372716] VM Stopped (Lifecycle Event)
Apr 12 07:53:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-04c6f480-3783-4caa-a7ce-c36ffb15578b None None] [instance: 3b7424e4-52aa-4330-a748-006240372716] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:15 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681285980.256286, c33e7825-1766-472a-8f09-c17a239fe63b => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:15 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] VM Stopped (Lifecycle Event)
Apr 12 07:53:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e927f4c4-7d00-4dce-bf7f-27cac9d78d54 None None] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing instance network info cache due to event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:53:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updated VIF entry in instance network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: INFO nova.compute.manager [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Detaching volume 957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:25 user nova-compute[82850]: INFO nova.virt.block_device [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Attempting to driver detach volume 957dad42-1b5b-4347-b512-2459774d09f4 from mountpoint /dev/vdb
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Attempting to detach device vdb from instance 40c8d6d7-d840-4417-b897-92ff8258d984 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:53:25 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:53:25 user nova-compute[82850]:   <source dev="/dev/sdf"/>
Apr 12 07:53:25 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:53:25 user nova-compute[82850]:   <serial>957dad42-1b5b-4347-b512-2459774d09f4</serial>
Apr 12 07:53:25 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:53:25 user nova-compute[82850]: </disk>
Apr 12 07:53:25 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully detached device vdb from instance 40c8d6d7-d840-4417-b897-92ff8258d984 from the persistent domain config.
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40c8d6d7-d840-4417-b897-92ff8258d984 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:53:25 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:53:25 user nova-compute[82850]:   <source dev="/dev/sdf"/>
Apr 12 07:53:25 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:53:25 user nova-compute[82850]:   <serial>957dad42-1b5b-4347-b512-2459774d09f4</serial>
Apr 12 07:53:25 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 07:53:25 user nova-compute[82850]: </disk>
Apr 12 07:53:25 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing instance network info cache due to event network-changed-8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Acquiring lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Acquired lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Refreshing network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:53:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681286006.0058465, 40c8d6d7-d840-4417-b897-92ff8258d984 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:53:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully detached device vdb from instance 40c8d6d7-d840-4417-b897-92ff8258d984 from the live domain config.
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAKMuSwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:53:26 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[81898c13-8bb0-49a0-b423-21f968ac3094]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:53:26 user nova-compute[82850]: No targets found.
Apr 12 07:53:26 user nova-compute[82850]: iSNS:
Apr 12 07:53:26 user nova-compute[82850]: No targets found.
Apr 12 07:53:26 user nova-compute[82850]: STATIC:
Apr 12 07:53:26 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:53:26 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:26 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:26 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4
Apr 12 07:53:26 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:26 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:26 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:53:26 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:26 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:26 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:53:26 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:26 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:26 user nova-compute[82850]: FIRMWARE:
Apr 12 07:53:26 user nova-compute[82850]: No targets found.
Apr 12 07:53:26 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:53:26 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:53:26 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de64878-03ca-42af-8b4f-4cd4c58be0ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[32967a58-2838-444c-a820-1956622f0d08]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:26 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 (non-flash)
Apr 12 07:53:26 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:26 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951fa1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4'): ({'sdf'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Removing single pathed devices sdf {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fd701b-a711-46d2-aaff-45884c56bcde]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce4614-67a0-43c0-b08c-1cb82763490a]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flushing IO for device /dev/sdf {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b4734b-4ffc-4a89-8a10-5f28d30393ff]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c2f40-f708-4686-ad3e-ec819cd07892]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] SCSI volumes sdf have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[894dba49-6873-4dd4-a480-ea1dbd987c3d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f9eca-2d0f-4bbf-9450-701182056ba6]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260]
Apr 12 07:53:26 user nova-compute[82850]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4, portal: 172.16.0.220,3260] successful.
Apr 12 07:53:26 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957dad42-1b5b-4347-b512-2459774d09f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b85016c-d477-4d71-85cd-12434c0090d1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== disconnect_volume: return (396ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.network.neutron [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updated VIF entry in instance network info cache for port 8c395303-b043-4eef-a6ac-e567893e6de4. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG nova.network.neutron [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [{"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Releasing lock "refresh_cache-40c8d6d7-d840-4417-b897-92ff8258d984" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7858MB free_disk=26.138057708740234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.613s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 40c8d6d7-d840-4417-b897-92ff8258d984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:53:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:53:28 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:53:28 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:53:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:53:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [{"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:53:32 user nova-compute[82850]: INFO nova.compute.manager [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Unrescuing
Apr 12 07:53:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'flavor' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:33 user nova-compute[82850]: WARNING nova.compute.manager [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:53:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance destroyed successfully.
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:35 user nova-compute[82850]: WARNING nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:53:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:35 user nova-compute[82850]: WARNING nova.compute.manager [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state rescued and task_state unrescuing.
Apr 12 07:53:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing instance network info cache due to event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:36 user nova-compute[82850]: INFO nova.compute.manager [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Detaching volume 845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:53:36 user nova-compute[82850]: INFO nova.virt.block_device [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Attempting to driver detach volume 845065d9-ece0-4d59-b500-cb1c3f40197f from mountpoint /dev/vdb
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Attempting to detach device vdb from instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:53:36 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:53:36 user nova-compute[82850]:   <source dev="/dev/sdd"/>
Apr 12 07:53:36 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:53:36 user nova-compute[82850]:   <serial>845065d9-ece0-4d59-b500-cb1c3f40197f</serial>
Apr 12 07:53:36 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:53:36 user nova-compute[82850]: </disk>
Apr 12 07:53:36 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:53:36 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully detached device vdb from instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 from the persistent domain config.
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:53:36 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:53:36 user nova-compute[82850]:   <source dev="/dev/sdd"/>
Apr 12 07:53:36 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:53:36 user nova-compute[82850]:   <serial>845065d9-ece0-4d59-b500-cb1c3f40197f</serial>
Apr 12 07:53:36 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:53:36 user nova-compute[82850]: </disk>
Apr 12 07:53:36 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updated VIF entry in instance network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681286017.2324188, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:53:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully detached device vdb from instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 from the live domain config.
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwsGiBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:53:37 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab334f-9f45-4e67-8600-37c3475394bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:53:37 user nova-compute[82850]: No targets found.
Apr 12 07:53:37 user nova-compute[82850]: iSNS:
Apr 12 07:53:37 user nova-compute[82850]: No targets found.
Apr 12 07:53:37 user nova-compute[82850]: STATIC:
Apr 12 07:53:37 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:53:37 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:37 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:37 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f
Apr 12 07:53:37 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:37 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:37 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:53:37 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:53:37 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:53:37 user nova-compute[82850]: FIRMWARE:
Apr 12 07:53:37 user nova-compute[82850]: No targets found.
Apr 12 07:53:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:53:37 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:53:37 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436ce46-c3fb-4b73-9488-8ec6525340d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba20cb6-edaa-4054-bd9e-08f13ddea55f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:37 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:37 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f (non-flash)
Apr 12 07:53:37 user nova-compute[82850]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:53:37 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:53:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f193420cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f'): ({'sdd'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Removing single pathed devices sdd {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058e651-19d6-4d78-abdf-97f5cf209317]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 4f136818-14e2-4d2e-81db-cb32a3ecd497 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286017.3552256, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Resumed (Lifecycle Event)
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a80aa5-eec3-4334-b5a4-ebfff9272cb3]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flushing IO for device /dev/sdd {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa6708f-49f1-4045-9f9e-94674920e9fe]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286017.3564136, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Started (Lifecycle Event)
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb1fa6-30e1-4abd-977d-633a11a2b89d]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f5f04f-9134-4bf0-a9ee-04a469581f9f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4405272-5f37-4197-a69b-9200e5449ae7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260]
Apr 12 07:53:37 user nova-compute[82850]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f, portal: 172.16.0.220,3260] successful.
Apr 12 07:53:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845065d9-ece0-4d59-b500-cb1c3f40197f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c3ff8-ebec-48f7-86df-7b7d9069489a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] <== disconnect_volume: return (332ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:37 user nova-compute[82850]: WARNING nova.compute.manager [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state None.
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing instance network info cache due to event network-changed-2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Acquiring lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Acquired lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Refreshing network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updated VIF entry in instance network info cache for port 2805f98a-2ed0-4f69-b952-25ebe25cf704. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [{"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Releasing lock "refresh_cache-2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:53:45 user nova-compute[82850]: INFO nova.compute.claims [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Claim successful on node user
Apr 12 07:53:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:53:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.policy [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:53:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Creating image(s)
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "/opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.177s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk 1073741824" returned: 0 in 0.059s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Cannot resize image /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'migration_context' on Instance uuid 4dcaf13a-b6cd-4a95-92ec-febb027915d3 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Ensure instance console log exists: /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:46 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Successfully created port: 2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Successfully updated port: 2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing instance network info cache due to event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Acquiring lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Instance network_info: |[{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Acquired lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.neutron [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Start _get_guest_xml network_info=[{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:53:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2014431968',display_name='tempest-ServerActionsTestJSON-server-2014431968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2014431968',id=30,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-gerbsjo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=4dcaf13a-b6cd-4a95-92ec-febb027915d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:53:47 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dcaf13a-b6cd-4a95-92ec-febb027915d3 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:53:48 user nova-compute[82850]:   <uuid>4dcaf13a-b6cd-4a95-92ec-febb027915d3</uuid>
Apr 12 07:53:48 user nova-compute[82850]:   <name>instance-0000001e</name>
Apr 12 07:53:48 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:53:48 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:53:48 user nova-compute[82850]:   <metadata>
Apr 12 07:53:48 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:53:48 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-2014431968</nova:name>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:53:47</nova:creationTime>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:53:48 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:53:48 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:owner>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:53:48 user nova-compute[82850]:       </nova:owner>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:53:48 user nova-compute[82850]:       <nova:ports>
Apr 12 07:53:48 user nova-compute[82850]:         <nova:port uuid="2bf3e827-1777-48cf-a8fc-0eeff964afe7">
Apr 12 07:53:48 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 07:53:48 user nova-compute[82850]:         </nova:port>
Apr 12 07:53:48 user nova-compute[82850]:       </nova:ports>
Apr 12 07:53:48 user nova-compute[82850]:     </nova:instance>
Apr 12 07:53:48 user nova-compute[82850]:   </metadata>
Apr 12 07:53:48 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:53:48 user nova-compute[82850]:     <system>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="serial">4dcaf13a-b6cd-4a95-92ec-febb027915d3</entry>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="uuid">4dcaf13a-b6cd-4a95-92ec-febb027915d3</entry>
Apr 12 07:53:48 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:53:48 user nova-compute[82850]:     </system>
Apr 12 07:53:48 user nova-compute[82850]:   </sysinfo>
Apr 12 07:53:48 user nova-compute[82850]:   <os>
Apr 12 07:53:48 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:53:48 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:53:48 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:53:48 user nova-compute[82850]:   </os>
Apr 12 07:53:48 user nova-compute[82850]:   <features>
Apr 12 07:53:48 user nova-compute[82850]:     <acpi/>
Apr 12 07:53:48 user nova-compute[82850]:     <apic/>
Apr 12 07:53:48 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:53:48 user nova-compute[82850]:   </features>
Apr 12 07:53:48 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:53:48 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:53:48 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:53:48 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:53:48 user nova-compute[82850]:   </clock>
Apr 12 07:53:48 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:53:48 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:53:48 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:53:48 user nova-compute[82850]:   </cpu>
Apr 12 07:53:48 user nova-compute[82850]:   <devices>
Apr 12 07:53:48 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:53:48 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:53:48 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk"/>
Apr 12 07:53:48 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:53:48 user nova-compute[82850]:     </disk>
Apr 12 07:53:48 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:53:48 user nova-compute[82850]:       <mac address="fa:16:3e:06:b7:4d"/>
Apr 12 07:53:48 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:53:48 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:53:48 user nova-compute[82850]:       <target dev="tap2bf3e827-17"/>
Apr 12 07:53:48 user nova-compute[82850]:     </interface>
Apr 12 07:53:48 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:53:48 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/console.log" append="off"/>
Apr 12 07:53:48 user nova-compute[82850]:     </serial>
Apr 12 07:53:48 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:53:48 user nova-compute[82850]:     <video>
Apr 12 07:53:48 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:53:48 user nova-compute[82850]:     </video>
Apr 12 07:53:48 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:53:48 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:53:48 user nova-compute[82850]:     </rng>
Apr 12 07:53:48 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:53:48 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:53:48 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:53:48 user nova-compute[82850]:     </memballoon>
Apr 12 07:53:48 user nova-compute[82850]:   </devices>
Apr 12 07:53:48 user nova-compute[82850]: </domain>
Apr 12 07:53:48 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2014431968',display_name='tempest-ServerActionsTestJSON-server-2014431968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2014431968',id=30,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-gerbsjo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=4dcaf13a-b6cd-4a95-92ec-febb027915d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG os_vif [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bf3e827-17, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bf3e827-17, col_values=(('external_ids', {'iface-id': '2bf3e827-1777-48cf-a8fc-0eeff964afe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b7:4d', 'vm-uuid': '4dcaf13a-b6cd-4a95-92ec-febb027915d3'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:48 user nova-compute[82850]: INFO os_vif [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17')
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:06:b7:4d, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.network.neutron [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updated VIF entry in instance network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG nova.network.neutron [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Releasing lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:49 user nova-compute[82850]: DEBUG nova.compute.manager [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] No waiting events found dispatching network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:49 user nova-compute[82850]: WARNING nova.compute.manager [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received unexpected event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance with vm_state building and task_state spawning.
Apr 12 07:53:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286031.6655254, 4dcaf13a-b6cd-4a95-92ec-febb027915d3 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] VM Resumed (Lifecycle Event)
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Instance spawned successfully.
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286031.6666484, 4dcaf13a-b6cd-4a95-92ec-febb027915d3 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] VM Started (Lifecycle Event)
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:51 user nova-compute[82850]: DEBUG nova.compute.manager [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] No waiting events found dispatching network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:51 user nova-compute[82850]: WARNING nova.compute.manager [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received unexpected event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance with vm_state building and task_state spawning.
Apr 12 07:53:51 user nova-compute[82850]: INFO nova.compute.manager [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Took 6.87 seconds to build instance.
Apr 12 07:53:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:53:53 user nova-compute[82850]: INFO nova.compute.claims [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Claim successful on node user
Apr 12 07:53:53 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:53:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.policy [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:53:54 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Creating image(s)
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "/opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "/opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "/opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk 1073741824" returned: 0 in 0.051s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Cannot resize image /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'migration_context' on Instance uuid 611c996f-b32c-4d8f-86c5-b48e492c7d43 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Successfully created port: 9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Ensure instance console log exists: /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Successfully updated port: 9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquired lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-changed-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Refreshing instance network info cache due to event network-changed-9a9860b6-35f6-4ce3-8509-6db0cd53c16e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Acquiring lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Updating instance_info_cache with network_info: [{"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Releasing lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Instance network_info: |[{"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Acquired lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Refreshing network info cache for port 9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Start _get_guest_xml network_info=[{"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:53:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1973938028',display_name='tempest-VolumesActionsTest-instance-1973938028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1973938028',id=31,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-voput0dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:53:54Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=611c996f-b32c-4d8f-86c5-b48e492c7d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'pci_devices' on Instance uuid 611c996f-b32c-4d8f-86c5-b48e492c7d43 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:53:56 user nova-compute[82850]:   <uuid>611c996f-b32c-4d8f-86c5-b48e492c7d43</uuid>
Apr 12 07:53:56 user nova-compute[82850]:   <name>instance-0000001f</name>
Apr 12 07:53:56 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:53:56 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:53:56 user nova-compute[82850]:   <metadata>
Apr 12 07:53:56 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:53:56 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:name>tempest-VolumesActionsTest-instance-1973938028</nova:name>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:53:56</nova:creationTime>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:53:56 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:53:56 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:owner>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:user uuid="0758a81ac62548b1b39ab0487835c360">tempest-VolumesActionsTest-236815586-project-member</nova:user>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:project uuid="a1fd2e19a7d6462fbcfb1e4e7d46ac36">tempest-VolumesActionsTest-236815586</nova:project>
Apr 12 07:53:56 user nova-compute[82850]:       </nova:owner>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:53:56 user nova-compute[82850]:       <nova:ports>
Apr 12 07:53:56 user nova-compute[82850]:         <nova:port uuid="9a9860b6-35f6-4ce3-8509-6db0cd53c16e">
Apr 12 07:53:56 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 07:53:56 user nova-compute[82850]:         </nova:port>
Apr 12 07:53:56 user nova-compute[82850]:       </nova:ports>
Apr 12 07:53:56 user nova-compute[82850]:     </nova:instance>
Apr 12 07:53:56 user nova-compute[82850]:   </metadata>
Apr 12 07:53:56 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:53:56 user nova-compute[82850]:     <system>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="serial">611c996f-b32c-4d8f-86c5-b48e492c7d43</entry>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="uuid">611c996f-b32c-4d8f-86c5-b48e492c7d43</entry>
Apr 12 07:53:56 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:53:56 user nova-compute[82850]:     </system>
Apr 12 07:53:56 user nova-compute[82850]:   </sysinfo>
Apr 12 07:53:56 user nova-compute[82850]:   <os>
Apr 12 07:53:56 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:53:56 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:53:56 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:53:56 user nova-compute[82850]:   </os>
Apr 12 07:53:56 user nova-compute[82850]:   <features>
Apr 12 07:53:56 user nova-compute[82850]:     <acpi/>
Apr 12 07:53:56 user nova-compute[82850]:     <apic/>
Apr 12 07:53:56 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:53:56 user nova-compute[82850]:   </features>
Apr 12 07:53:56 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:53:56 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:53:56 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:53:56 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:53:56 user nova-compute[82850]:   </clock>
Apr 12 07:53:56 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:53:56 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:53:56 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:53:56 user nova-compute[82850]:   </cpu>
Apr 12 07:53:56 user nova-compute[82850]:   <devices>
Apr 12 07:53:56 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:53:56 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:53:56 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk"/>
Apr 12 07:53:56 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:53:56 user nova-compute[82850]:     </disk>
Apr 12 07:53:56 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:53:56 user nova-compute[82850]:       <mac address="fa:16:3e:b1:94:07"/>
Apr 12 07:53:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:53:56 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:53:56 user nova-compute[82850]:       <target dev="tap9a9860b6-35"/>
Apr 12 07:53:56 user nova-compute[82850]:     </interface>
Apr 12 07:53:56 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:53:56 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/console.log" append="off"/>
Apr 12 07:53:56 user nova-compute[82850]:     </serial>
Apr 12 07:53:56 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:53:56 user nova-compute[82850]:     <video>
Apr 12 07:53:56 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:53:56 user nova-compute[82850]:     </video>
Apr 12 07:53:56 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:53:56 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:53:56 user nova-compute[82850]:     </rng>
Apr 12 07:53:56 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:53:56 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:53:56 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:53:56 user nova-compute[82850]:     </memballoon>
Apr 12 07:53:56 user nova-compute[82850]:   </devices>
Apr 12 07:53:56 user nova-compute[82850]: </domain>
Apr 12 07:53:56 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1973938028',display_name='tempest-VolumesActionsTest-instance-1973938028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1973938028',id=31,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-voput0dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:53:54Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=611c996f-b32c-4d8f-86c5-b48e492c7d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG os_vif [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9860b6-35, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a9860b6-35, col_values=(('external_ids', {'iface-id': '9a9860b6-35f6-4ce3-8509-6db0cd53c16e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:94:07', 'vm-uuid': '611c996f-b32c-4d8f-86c5-b48e492c7d43'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:56 user nova-compute[82850]: INFO os_vif [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35')
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] No VIF found with MAC fa:16:3e:b1:94:07, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Updated VIF entry in instance network info cache for port 9a9860b6-35f6-4ce3-8509-6db0cd53c16e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Updating instance_info_cache with network_info: [{"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:53:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Releasing lock "refresh_cache-611c996f-b32c-4d8f-86c5-b48e492c7d43" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] No waiting events found dispatching network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:57 user nova-compute[82850]: WARNING nova.compute.manager [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received unexpected event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance with vm_state building and task_state spawning.
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286039.842495, 611c996f-b32c-4d8f-86c5-b48e492c7d43 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] VM Resumed (Lifecycle Event)
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Instance spawned successfully.
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286039.8462691, 611c996f-b32c-4d8f-86c5-b48e492c7d43 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] VM Started (Lifecycle Event)
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] No waiting events found dispatching network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:53:59 user nova-compute[82850]: WARNING nova.compute.manager [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received unexpected event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance with vm_state building and task_state spawning.
Apr 12 07:53:59 user nova-compute[82850]: INFO nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 12 07:53:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:00 user nova-compute[82850]: INFO nova.compute.manager [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Took 6.55 seconds to build instance.
Apr 12 07:54:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:19 user nova-compute[82850]: INFO nova.compute.manager [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Terminating instance
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-unplugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:54:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Instance destroyed successfully.
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'resources' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-381898933',display_name='tempest-TestMinimumBasicScenario-server-381898933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-381898933',id=24,image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ==',key_name='tempest-TestMinimumBasicScenario-788402656',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-1ylos7nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='47938fc9-ecf8-4c1a-8f19-67593f191ec6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:51:40Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=40c8d6d7-d840-4417-b897-92ff8258d984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "8c395303-b043-4eef-a6ac-e567893e6de4", "address": "fa:16:3e:4d:b3:b8", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c395303-b0", "ovs_interfaceid": "8c395303-b043-4eef-a6ac-e567893e6de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG os_vif [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c395303-b0, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:19 user nova-compute[82850]: INFO os_vif [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=8c395303-b043-4eef-a6ac-e567893e6de4,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c395303-b0')
Apr 12 07:54:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Deleting instance files /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984_del
Apr 12 07:54:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Deletion of /opt/stack/data/nova/instances/40c8d6d7-d840-4417-b897-92ff8258d984_del complete
Apr 12 07:54:19 user nova-compute[82850]: INFO nova.compute.manager [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 07:54:19 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:54:19 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:20 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Took 0.59 seconds to deallocate network for instance.
Apr 12 07:54:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-deleted-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:20 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Deleted allocations for instance 40c8d6d7-d840-4417-b897-92ff8258d984
Apr 12 07:54:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "40c8d6d7-d840-4417-b897-92ff8258d984" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.980s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Acquiring lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Lock "40c8d6d7-d840-4417-b897-92ff8258d984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] No waiting events found dispatching network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:21 user nova-compute[82850]: WARNING nova.compute.manager [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Received unexpected event network-vif-plugged-8c395303-b043-4eef-a6ac-e567893e6de4 for instance with vm_state deleted and task_state None.
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:54:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:27 user nova-compute[82850]: INFO nova.compute.manager [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Terminating instance
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing instance network info cache due to event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Acquiring lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Acquired lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:54:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:54:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=26.106555938720703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance acbd6126-210b-41cf-a994-528233e5369b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-unplugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:54:27 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updated VIF entry in instance network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating instance_info_cache with network_info: [{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Releasing lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:54:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Instance destroyed successfully.
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976346504',display_name='tempest-ServerRescueNegativeTestJSON-server-1976346504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1976346504',id=22,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqGGXXPtvQkc4Q+1b1tPxLW6NgPiaphqfUdgbK5JXJXP525ewACIqwvdzXe6oF4g+7xY5gbo/sFkRUpVm0ItlkNFkuEY1IfoP9Pq3jpaEgq3F2toZknWB7N0LTVnEYTQg==',key_name='tempest-keypair-44620121',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-xjamlmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86009132a34b466399da1701f47316d9',uuid=2d96b11f-6cb6-4d16-acd3-94f7ae0c2350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "address": "fa:16:3e:cd:6b:30", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2805f98a-2e", "ovs_interfaceid": "2805f98a-2ed0-4f69-b952-25ebe25cf704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG os_vif [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2805f98a-2e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:54:28 user nova-compute[82850]: INFO os_vif [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:6b:30,bridge_name='br-int',has_traffic_filtering=True,id=2805f98a-2ed0-4f69-b952-25ebe25cf704,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2805f98a-2e')
Apr 12 07:54:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Deleting instance files /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350_del
Apr 12 07:54:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Deletion of /opt/stack/data/nova/instances/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350_del complete
Apr 12 07:54:28 user nova-compute[82850]: INFO nova.compute.manager [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 07:54:28 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:54:28 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:29 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Took 0.93 seconds to deallocate network for instance.
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-deleted-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [{"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-acbd6126-210b-41cf-a994-528233e5369b" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:29 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Deleted allocations for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.738s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Acquiring lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Lock "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] No waiting events found dispatching network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:29 user nova-compute[82850]: WARNING nova.compute.manager [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Received unexpected event network-vif-plugged-2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance with vm_state deleted and task_state None.
Apr 12 07:54:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:54:33 user nova-compute[82850]: INFO nova.compute.claims [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Claim successful on node user
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:54:34 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:54:34 user nova-compute[82850]: INFO nova.virt.block_device [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Booting with volume 0b434b43-ce87-4cac-96e7-642f1686222b at /dev/vda
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.policy [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.utils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688fb6b-2987-4577-bec6-750a67c4e8d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44885ce5-36f0-4dff-8db0-0585901e087c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b164db-3ba0-4a19-929f-dfe183e28aed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee2980-c77e-4df6-96ca-4ae862b66784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:54:34 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:54:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f2160-0b75-4be7-bb74-b93d2812f862]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG os_brick.utils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating existing volume attachment record: a6ee0add-963d-4de1-92d9-558dbb78bc15 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286059.8214989, 40c8d6d7-d840-4417-b897-92ff8258d984 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:54:34 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] VM Stopped (Lifecycle Event)
Apr 12 07:54:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a0b81d6a-1878-406b-9128-5e98e31bcfa5 None None] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Successfully created port: cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Successfully updated port: cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquired lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing instance network info cache due to event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Acquiring lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:54:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Releasing lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Instance network_info: |[{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Acquired lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updated VIF entry in instance network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:54:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Releasing lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:54:38 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Creating image(s)
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/137c8fe9-a53f-4d00-84ed-63df965d3cb9/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Start _get_guest_xml network_info=[{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDFLYTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '137c8fe9-a53f-4d00-84ed-63df965d3cb9', 'attached_at': '', 'detached_at': '', 'volume_id': '0b434b43-ce87-4cac-96e7-642f1686222b', 'serial': '0b434b43-ce87-4cac-96e7-642f1686222b'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'a6ee0add-963d-4de1-92d9-558dbb78bc15', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:54:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:54:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDFLYTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:54:38 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:54:38 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:54:38 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d480871c-d643-4e54-be7c-b76688a863ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:54:38 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[46328428-6475-49ba-84fe-30ab0c675b2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b] added
Apr 12 07:54:38 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e61d41-23ba-4931-8fc9-39ad4e2b935a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f326221-4ee6-4079-928b-10ce9761e530]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDFLYTI {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpDFLYTI" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d202ffd-d272-4a4a-b547-6ec8940448e8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpDFLYTI'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0abc658-d1d9-4e03-9f43-90f813fe0edd]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccc6a1-34b7-4aeb-99e4-d831078e770a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:54:38 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:54:38 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:54:38 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:54:38 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:54:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b457edf1-abcb-44e1-93b1-6cae93ef0235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260]
Apr 12 07:54:39 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260] successful.
Apr 12 07:54:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea157c76-1914-414b-9d2d-d07004a3af00]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ca5ee-746f-4c66-81d9-76339ecf2378]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:54:39 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:54:39 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:54:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:54:39 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:54:39 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:54:39 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf6697-53f3-4a88-8e9b-752ac79702a1]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:54:39 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDFLYTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26365316163633361', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365316163633361', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850084019',display_name='tempest-TestVolumeBootPattern-server-850084019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850084019',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-q8yy8ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:54:34Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=137c8fe9-a53f-4d00-84ed-63df965d3cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'pci_devices' on Instance uuid 137c8fe9-a53f-4d00-84ed-63df965d3cb9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:54:40 user nova-compute[82850]:   <uuid>137c8fe9-a53f-4d00-84ed-63df965d3cb9</uuid>
Apr 12 07:54:40 user nova-compute[82850]:   <name>instance-00000020</name>
Apr 12 07:54:40 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:54:40 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:54:40 user nova-compute[82850]:   <metadata>
Apr 12 07:54:40 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:54:40 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:54:40 user nova-compute[82850]:       <nova:name>tempest-TestVolumeBootPattern-server-850084019</nova:name>
Apr 12 07:54:40 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:54:38</nova:creationTime>
Apr 12 07:54:40 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:54:40 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:54:40 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:54:40 user nova-compute[82850]:       <nova:owner>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:user uuid="71763ade39bb43eb947ea6f175ce68c1">tempest-TestVolumeBootPattern-11493924-project-member</nova:user>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:project uuid="145931c86ba9489684b6eabb936b9738">tempest-TestVolumeBootPattern-11493924</nova:project>
Apr 12 07:54:40 user nova-compute[82850]:       </nova:owner>
Apr 12 07:54:40 user nova-compute[82850]:       <nova:ports>
Apr 12 07:54:40 user nova-compute[82850]:         <nova:port uuid="cc999de7-d108-42bc-a880-e680f48b60c1">
Apr 12 07:54:40 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 07:54:40 user nova-compute[82850]:         </nova:port>
Apr 12 07:54:40 user nova-compute[82850]:       </nova:ports>
Apr 12 07:54:40 user nova-compute[82850]:     </nova:instance>
Apr 12 07:54:40 user nova-compute[82850]:   </metadata>
Apr 12 07:54:40 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:54:40 user nova-compute[82850]:     <system>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="serial">137c8fe9-a53f-4d00-84ed-63df965d3cb9</entry>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="uuid">137c8fe9-a53f-4d00-84ed-63df965d3cb9</entry>
Apr 12 07:54:40 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:54:40 user nova-compute[82850]:     </system>
Apr 12 07:54:40 user nova-compute[82850]:   </sysinfo>
Apr 12 07:54:40 user nova-compute[82850]:   <os>
Apr 12 07:54:40 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:54:40 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:54:40 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:54:40 user nova-compute[82850]:   </os>
Apr 12 07:54:40 user nova-compute[82850]:   <features>
Apr 12 07:54:40 user nova-compute[82850]:     <acpi/>
Apr 12 07:54:40 user nova-compute[82850]:     <apic/>
Apr 12 07:54:40 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:54:40 user nova-compute[82850]:   </features>
Apr 12 07:54:40 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:54:40 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:54:40 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:54:40 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:54:40 user nova-compute[82850]:   </clock>
Apr 12 07:54:40 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:54:40 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:54:40 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:54:40 user nova-compute[82850]:   </cpu>
Apr 12 07:54:40 user nova-compute[82850]:   <devices>
Apr 12 07:54:40 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:54:40 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:54:40 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 07:54:40 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:54:40 user nova-compute[82850]:       <serial>0b434b43-ce87-4cac-96e7-642f1686222b</serial>
Apr 12 07:54:40 user nova-compute[82850]:     </disk>
Apr 12 07:54:40 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:54:40 user nova-compute[82850]:       <mac address="fa:16:3e:77:9e:4e"/>
Apr 12 07:54:40 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:54:40 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:54:40 user nova-compute[82850]:       <target dev="tapcc999de7-d1"/>
Apr 12 07:54:40 user nova-compute[82850]:     </interface>
Apr 12 07:54:40 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:54:40 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/137c8fe9-a53f-4d00-84ed-63df965d3cb9/console.log" append="off"/>
Apr 12 07:54:40 user nova-compute[82850]:     </serial>
Apr 12 07:54:40 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:54:40 user nova-compute[82850]:     <video>
Apr 12 07:54:40 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:54:40 user nova-compute[82850]:     </video>
Apr 12 07:54:40 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:54:40 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:54:40 user nova-compute[82850]:     </rng>
Apr 12 07:54:40 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:54:40 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:54:40 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:54:40 user nova-compute[82850]:     </memballoon>
Apr 12 07:54:40 user nova-compute[82850]:   </devices>
Apr 12 07:54:40 user nova-compute[82850]: </domain>
Apr 12 07:54:40 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850084019',display_name='tempest-TestVolumeBootPattern-server-850084019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850084019',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-q8yy8ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:54:34Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=137c8fe9-a53f-4d00-84ed-63df965d3cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG os_vif [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc999de7-d1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc999de7-d1, col_values=(('external_ids', {'iface-id': 'cc999de7-d108-42bc-a880-e680f48b60c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:9e:4e', 'vm-uuid': '137c8fe9-a53f-4d00-84ed-63df965d3cb9'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:40 user nova-compute[82850]: INFO os_vif [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1')
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:54:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] No VIF found with MAC fa:16:3e:77:9e:4e, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] No waiting events found dispatching network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:41 user nova-compute[82850]: WARNING nova.compute.manager [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received unexpected event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 for instance with vm_state building and task_state spawning.
Apr 12 07:54:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286068.3037543, 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] VM Stopped (Lifecycle Event)
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e7cdb916-2d13-4dd0-9593-a3a71900ee9d None None] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286083.6026232, 137c8fe9-a53f-4d00-84ed-63df965d3cb9 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] VM Resumed (Lifecycle Event)
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Instance spawned successfully.
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286083.6044283, 137c8fe9-a53f-4d00-84ed-63df965d3cb9 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] VM Started (Lifecycle Event)
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] No waiting events found dispatching network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:54:43 user nova-compute[82850]: WARNING nova.compute.manager [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received unexpected event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 for instance with vm_state building and task_state spawning.
Apr 12 07:54:43 user nova-compute[82850]: INFO nova.compute.manager [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Took 10.07 seconds to build instance.
Apr 12 07:54:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.170s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:54:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:54:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:12 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 07:55:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:55:13 user nova-compute[82850]: INFO nova.compute.claims [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Claim successful on node user
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:55:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.policy [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:55:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Creating image(s)
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "/opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "/opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "e71f764056e148ff65c1a51f070678664b752c7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "e71f764056e148ff65c1a51f070678664b752c7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.part --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG nova.virt.images [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 27758478-87f6-46a9-8895-882f41f56ed8 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.part /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Successfully created port: 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.part /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.converted" returned: 0 in 0.290s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "e71f764056e148ff65c1a51f070678664b752c7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.935s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json" returned: 0 in 0.277s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "e71f764056e148ff65c1a51f070678664b752c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "e71f764056e148ff65c1a51f070678664b752c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a,backing_fmt=raw /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a,backing_fmt=raw /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk 1073741824" returned: 0 in 0.047s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "e71f764056e148ff65c1a51f070678664b752c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Successfully updated port: 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-changed-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing instance network info cache due to event network-changed-277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Cannot resize image /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.objects.instance [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'migration_context' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Ensure instance console log exists: /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance network_info: |[{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.neutron [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Start _get_guest_xml network_info=[{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:55:10Z,direct_url=<?>,disk_format='qcow2',id=27758478-87f6-46a9-8895-882f41f56ed8,min_disk=0,min_ram=0,name='tempest-scenario-img--774592578',owner='27f4f7b1930e48cb82f5f6010872e221',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:55:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '27758478-87f6-46a9-8895-882f41f56ed8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:55:15 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:15 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:55:10Z,direct_url=<?>,disk_format='qcow2',id=27758478-87f6-46a9-8895-882f41f56ed8,min_disk=0,min_ram=0,name='tempest-scenario-img--774592578',owner='27f4f7b1930e48cb82f5f6010872e221',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:55:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1719272565',display_name='tempest-TestMinimumBasicScenario-server-1719272565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1719272565',id=33,image_ref='27758478-87f6-46a9-8895-882f41f56ed8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsJMgKR2OtLfQZhgaJUVQq7Qz6EmW1x26YrHrFvEapwB9N+yzYyW5wym/7oCwnZlsj89EtVjI1kDh92fCOQewJ9CfY+dmGsR7zSXq+UfbqqLPcqsbhfRlDZHAL5iHXXsg==',key_name='tempest-TestMinimumBasicScenario-623587583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-zl5foksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27758478-87f6-46a9-8895-882f41f56ed8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:14Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=bc267429-544b-4145-b4d9-8c2947c8c104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.objects.instance [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'pci_devices' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:55:15 user nova-compute[82850]:   <uuid>bc267429-544b-4145-b4d9-8c2947c8c104</uuid>
Apr 12 07:55:15 user nova-compute[82850]:   <name>instance-00000021</name>
Apr 12 07:55:15 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:55:15 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:55:15 user nova-compute[82850]:   <metadata>
Apr 12 07:55:15 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:55:15 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:name>tempest-TestMinimumBasicScenario-server-1719272565</nova:name>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:55:15</nova:creationTime>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:55:15 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:55:15 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:owner>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:user uuid="630f8381d3534fd3a1978fc0a931e8c0">tempest-TestMinimumBasicScenario-1759703879-project-member</nova:user>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:project uuid="27f4f7b1930e48cb82f5f6010872e221">tempest-TestMinimumBasicScenario-1759703879</nova:project>
Apr 12 07:55:15 user nova-compute[82850]:       </nova:owner>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:root type="image" uuid="27758478-87f6-46a9-8895-882f41f56ed8"/>
Apr 12 07:55:15 user nova-compute[82850]:       <nova:ports>
Apr 12 07:55:15 user nova-compute[82850]:         <nova:port uuid="277f41f9-00ba-4f58-9186-da42879de40e">
Apr 12 07:55:15 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 07:55:15 user nova-compute[82850]:         </nova:port>
Apr 12 07:55:15 user nova-compute[82850]:       </nova:ports>
Apr 12 07:55:15 user nova-compute[82850]:     </nova:instance>
Apr 12 07:55:15 user nova-compute[82850]:   </metadata>
Apr 12 07:55:15 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:55:15 user nova-compute[82850]:     <system>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="serial">bc267429-544b-4145-b4d9-8c2947c8c104</entry>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="uuid">bc267429-544b-4145-b4d9-8c2947c8c104</entry>
Apr 12 07:55:15 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:55:15 user nova-compute[82850]:     </system>
Apr 12 07:55:15 user nova-compute[82850]:   </sysinfo>
Apr 12 07:55:15 user nova-compute[82850]:   <os>
Apr 12 07:55:15 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:55:15 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:55:15 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:55:15 user nova-compute[82850]:   </os>
Apr 12 07:55:15 user nova-compute[82850]:   <features>
Apr 12 07:55:15 user nova-compute[82850]:     <acpi/>
Apr 12 07:55:15 user nova-compute[82850]:     <apic/>
Apr 12 07:55:15 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:55:15 user nova-compute[82850]:   </features>
Apr 12 07:55:15 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:55:15 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:55:15 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:55:15 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:55:15 user nova-compute[82850]:   </clock>
Apr 12 07:55:15 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:55:15 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:55:15 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:55:15 user nova-compute[82850]:   </cpu>
Apr 12 07:55:15 user nova-compute[82850]:   <devices>
Apr 12 07:55:15 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:55:15 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:55:15 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk"/>
Apr 12 07:55:15 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:55:15 user nova-compute[82850]:     </disk>
Apr 12 07:55:15 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:55:15 user nova-compute[82850]:       <mac address="fa:16:3e:0d:00:44"/>
Apr 12 07:55:15 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:15 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:55:15 user nova-compute[82850]:       <target dev="tap277f41f9-00"/>
Apr 12 07:55:15 user nova-compute[82850]:     </interface>
Apr 12 07:55:15 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:55:15 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/console.log" append="off"/>
Apr 12 07:55:15 user nova-compute[82850]:     </serial>
Apr 12 07:55:15 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:55:15 user nova-compute[82850]:     <video>
Apr 12 07:55:15 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:15 user nova-compute[82850]:     </video>
Apr 12 07:55:15 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:55:15 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:55:15 user nova-compute[82850]:     </rng>
Apr 12 07:55:15 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:55:15 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:55:15 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:55:15 user nova-compute[82850]:     </memballoon>
Apr 12 07:55:15 user nova-compute[82850]:   </devices>
Apr 12 07:55:15 user nova-compute[82850]: </domain>
Apr 12 07:55:15 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1719272565',display_name='tempest-TestMinimumBasicScenario-server-1719272565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1719272565',id=33,image_ref='27758478-87f6-46a9-8895-882f41f56ed8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsJMgKR2OtLfQZhgaJUVQq7Qz6EmW1x26YrHrFvEapwB9N+yzYyW5wym/7oCwnZlsj89EtVjI1kDh92fCOQewJ9CfY+dmGsR7zSXq+UfbqqLPcqsbhfRlDZHAL5iHXXsg==',key_name='tempest-TestMinimumBasicScenario-623587583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-zl5foksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27758478-87f6-46a9-8895-882f41f56ed8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:14Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=bc267429-544b-4145-b4d9-8c2947c8c104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG os_vif [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap277f41f9-00, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap277f41f9-00, col_values=(('external_ids', {'iface-id': '277f41f9-00ba-4f58-9186-da42879de40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:00:44', 'vm-uuid': 'bc267429-544b-4145-b4d9-8c2947c8c104'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:15 user nova-compute[82850]: INFO os_vif [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00')
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No VIF found with MAC fa:16:3e:0d:00:44, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:55:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG nova.network.neutron [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updated VIF entry in instance network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG nova.network.neutron [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG nova.compute.manager [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:17 user nova-compute[82850]: WARNING nova.compute.manager [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state building and task_state spawning.
Apr 12 07:55:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286119.003164, bc267429-544b-4145-b4d9-8c2947c8c104 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] VM Resumed (Lifecycle Event)
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance spawned successfully.
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286119.0045366, bc267429-544b-4145-b4d9-8c2947c8c104 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] VM Started (Lifecycle Event)
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:19 user nova-compute[82850]: INFO nova.compute.manager [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Took 6.21 seconds to build instance.
Apr 12 07:55:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.307s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:19 user nova-compute[82850]: WARNING nova.compute.manager [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state active and task_state None.
Apr 12 07:55:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:20 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 07:55:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 07:55:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:22 user nova-compute[82850]: INFO nova.compute.manager [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Terminating instance
Apr 12 07:55:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:55:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-unplugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:55:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Instance destroyed successfully.
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377191038',display_name='tempest-ServerRescueNegativeTestJSON-server-377191038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377191038',id=5,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:41:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-1nh4kdns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:41:24Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=acbd6126-210b-41cf-a994-528233e5369b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "72eb7ca6-62de-4e4f-b40f-52343e160945", "address": "fa:16:3e:6c:18:60", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72eb7ca6-62", "ovs_interfaceid": "72eb7ca6-62de-4e4f-b40f-52343e160945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG os_vif [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72eb7ca6-62, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:55:23 user nova-compute[82850]: INFO os_vif [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:18:60,bridge_name='br-int',has_traffic_filtering=True,id=72eb7ca6-62de-4e4f-b40f-52343e160945,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72eb7ca6-62')
Apr 12 07:55:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Deleting instance files /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b_del
Apr 12 07:55:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Deletion of /opt/stack/data/nova/instances/acbd6126-210b-41cf-a994-528233e5369b_del complete
Apr 12 07:55:23 user nova-compute[82850]: INFO nova.compute.manager [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Took 0.75 seconds to destroy the instance on the hypervisor.
Apr 12 07:55:23 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:55:23 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:24 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] Took 0.73 seconds to deallocate network for instance.
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-deleted-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:24 user nova-compute[82850]: INFO nova.compute.manager [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Neutron deleted interface 72eb7ca6-62de-4e4f-b40f-52343e160945; detaching it from the instance and deleting it from the info cache
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.network.neutron [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Detach interface failed, port_id=72eb7ca6-62de-4e4f-b40f-52343e160945, reason: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.657s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.329s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:55:25 user nova-compute[82850]: INFO nova.compute.claims [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Claim successful on node user
Apr 12 07:55:25 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Deleted allocations for instance acbd6126-210b-41cf-a994-528233e5369b
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "acbd6126-210b-41cf-a994-528233e5369b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Acquiring lock "acbd6126-210b-41cf-a994-528233e5369b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Lock "acbd6126-210b-41cf-a994-528233e5369b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] No waiting events found dispatching network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:25 user nova-compute[82850]: WARNING nova.compute.manager [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] [instance: acbd6126-210b-41cf-a994-528233e5369b] Received unexpected event network-vif-plugged-72eb7ca6-62de-4e4f-b40f-52343e160945 for instance with vm_state deleted and task_state None.
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.932s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:55:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.policy [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:55:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Creating image(s)
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk 1073741824" returned: 0 in 0.049s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Cannot resize image /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'migration_context' on Instance uuid c2da4832-f77d-4e42-85f0-8e370c69f7b8 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Successfully created port: 1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Successfully updated port: 1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-changed-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Refreshing instance network info cache due to event network-changed-1609868b-1b37-4997-81c6-d1390f862b7e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Acquiring lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Acquired lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Refreshing network info cache for port 1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7926MB free_disk=26.137271881103516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bc267429-544b-4145-b4d9-8c2947c8c104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Releasing lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Updating instance_info_cache with network_info: [{"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance network_info: |[{"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Start _get_guest_xml network_info=[{"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:55:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167399412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-167399412',id=34,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-v1j4hda1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:26Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=c2da4832-f77d-4e42-85f0-8e370c69f7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid c2da4832-f77d-4e42-85f0-8e370c69f7b8 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:55:28 user nova-compute[82850]:   <uuid>c2da4832-f77d-4e42-85f0-8e370c69f7b8</uuid>
Apr 12 07:55:28 user nova-compute[82850]:   <name>instance-00000022</name>
Apr 12 07:55:28 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:55:28 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:55:28 user nova-compute[82850]:   <metadata>
Apr 12 07:55:28 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:55:28 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-167399412</nova:name>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:55:28</nova:creationTime>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:55:28 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:55:28 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:owner>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 07:55:28 user nova-compute[82850]:       </nova:owner>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:55:28 user nova-compute[82850]:       <nova:ports>
Apr 12 07:55:28 user nova-compute[82850]:         <nova:port uuid="1609868b-1b37-4997-81c6-d1390f862b7e">
Apr 12 07:55:28 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 07:55:28 user nova-compute[82850]:         </nova:port>
Apr 12 07:55:28 user nova-compute[82850]:       </nova:ports>
Apr 12 07:55:28 user nova-compute[82850]:     </nova:instance>
Apr 12 07:55:28 user nova-compute[82850]:   </metadata>
Apr 12 07:55:28 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:55:28 user nova-compute[82850]:     <system>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="serial">c2da4832-f77d-4e42-85f0-8e370c69f7b8</entry>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="uuid">c2da4832-f77d-4e42-85f0-8e370c69f7b8</entry>
Apr 12 07:55:28 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:55:28 user nova-compute[82850]:     </system>
Apr 12 07:55:28 user nova-compute[82850]:   </sysinfo>
Apr 12 07:55:28 user nova-compute[82850]:   <os>
Apr 12 07:55:28 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:55:28 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:55:28 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:55:28 user nova-compute[82850]:   </os>
Apr 12 07:55:28 user nova-compute[82850]:   <features>
Apr 12 07:55:28 user nova-compute[82850]:     <acpi/>
Apr 12 07:55:28 user nova-compute[82850]:     <apic/>
Apr 12 07:55:28 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:55:28 user nova-compute[82850]:   </features>
Apr 12 07:55:28 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:55:28 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:55:28 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:55:28 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:55:28 user nova-compute[82850]:   </clock>
Apr 12 07:55:28 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:55:28 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:55:28 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:55:28 user nova-compute[82850]:   </cpu>
Apr 12 07:55:28 user nova-compute[82850]:   <devices>
Apr 12 07:55:28 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:55:28 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:55:28 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk"/>
Apr 12 07:55:28 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:55:28 user nova-compute[82850]:     </disk>
Apr 12 07:55:28 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:55:28 user nova-compute[82850]:       <mac address="fa:16:3e:72:f0:b0"/>
Apr 12 07:55:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:28 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:55:28 user nova-compute[82850]:       <target dev="tap1609868b-1b"/>
Apr 12 07:55:28 user nova-compute[82850]:     </interface>
Apr 12 07:55:28 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:55:28 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/console.log" append="off"/>
Apr 12 07:55:28 user nova-compute[82850]:     </serial>
Apr 12 07:55:28 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:55:28 user nova-compute[82850]:     <video>
Apr 12 07:55:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:28 user nova-compute[82850]:     </video>
Apr 12 07:55:28 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:55:28 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:55:28 user nova-compute[82850]:     </rng>
Apr 12 07:55:28 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:55:28 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:55:28 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:55:28 user nova-compute[82850]:     </memballoon>
Apr 12 07:55:28 user nova-compute[82850]:   </devices>
Apr 12 07:55:28 user nova-compute[82850]: </domain>
Apr 12 07:55:28 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167399412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-167399412',id=34,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-v1j4hda1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:26Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=c2da4832-f77d-4e42-85f0-8e370c69f7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG os_vif [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1609868b-1b, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1609868b-1b, col_values=(('external_ids', {'iface-id': '1609868b-1b37-4997-81c6-d1390f862b7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f0:b0', 'vm-uuid': 'c2da4832-f77d-4e42-85f0-8e370c69f7b8'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:28 user nova-compute[82850]: INFO os_vif [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b')
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:55:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:72:f0:b0, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] No waiting events found dispatching network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:30 user nova-compute[82850]: WARNING nova.compute.manager [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received unexpected event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e for instance with vm_state building and task_state spawning.
Apr 12 07:55:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286132.0752735, c2da4832-f77d-4e42-85f0-8e370c69f7b8 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] VM Resumed (Lifecycle Event)
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance spawned successfully.
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286132.0803962, c2da4832-f77d-4e42-85f0-8e370c69f7b8 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] VM Started (Lifecycle Event)
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] No waiting events found dispatching network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:32 user nova-compute[82850]: WARNING nova.compute.manager [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received unexpected event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e for instance with vm_state building and task_state spawning.
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Took 6.23 seconds to spawn the instance on the hypervisor.
Apr 12 07:55:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:32 user nova-compute[82850]: INFO nova.compute.manager [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Took 7.64 seconds to build instance.
Apr 12 07:55:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.791s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing instance network info cache due to event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Acquiring lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Acquired lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updated VIF entry in instance network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG nova.network.neutron [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Releasing lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:55:38 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286123.3912992, acbd6126-210b-41cf-a994-528233e5369b => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:38 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: acbd6126-210b-41cf-a994-528233e5369b] VM Stopped (Lifecycle Event)
Apr 12 07:55:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-31c590e9-f2fb-4335-ac0b-7e1134645b34 None None] [instance: acbd6126-210b-41cf-a994-528233e5369b] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:55:39 user nova-compute[82850]: INFO nova.compute.claims [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Claim successful on node user
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:55:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:55:40 user nova-compute[82850]: INFO nova.virt.block_device [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Booting with volume e0211892-4d87-4d0d-98ee-515eb41bc65b at /dev/vda
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.policy [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.utils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c7d0b-2fa7-4b7a-9b7f-5cfc6c2f065c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92108b27-4d34-45c9-9313-8ce2a3f9203c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[267feadc-e4e8-4a72-921e-1371b2422416]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f954fd9b-65dd-4a1d-a11c-56f98f6be919]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:55:40 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:55:40 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856071f-58df-4d99-a6e9-1d93f8b23c11]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG os_brick.utils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating existing volume attachment record: 5ca71cd0-9f6c-48d8-9b5c-bf2b07532757 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:55:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Successfully created port: eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Successfully updated port: eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-changed-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Refreshing instance network info cache due to event network-changed-eeac49a6-c1b5-4fcd-9fae-4caa4f651618. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance network_info: |[{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:55:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Refreshing network info cache for port eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:55:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updated VIF entry in instance network info cache for port eeac49a6-c1b5-4fcd-9fae-4caa4f651618. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:55:43 user nova-compute[82850]: DEBUG nova.network.neutron [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:55:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:44 user nova-compute[82850]: INFO nova.compute.manager [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Terminating instance
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-unplugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] No waiting events found dispatching network-vif-unplugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-unplugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:55:44 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Instance destroyed successfully.
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'resources' on Instance uuid 611c996f-b32c-4d8f-86c5-b48e492c7d43 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1973938028',display_name='tempest-VolumesActionsTest-instance-1973938028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1973938028',id=31,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-voput0dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:54:00Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=611c996f-b32c-4d8f-86c5-b48e492c7d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "address": "fa:16:3e:b1:94:07", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9860b6-35", "ovs_interfaceid": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG os_vif [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9860b6-35, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:55:44 user nova-compute[82850]: INFO os_vif [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:94:07,bridge_name='br-int',has_traffic_filtering=True,id=9a9860b6-35f6-4ce3-8509-6db0cd53c16e,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9860b6-35')
Apr 12 07:55:44 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Deleting instance files /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43_del
Apr 12 07:55:44 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Deletion of /opt/stack/data/nova/instances/611c996f-b32c-4d8f-86c5-b48e492c7d43_del complete
Apr 12 07:55:44 user nova-compute[82850]: INFO nova.compute.manager [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 07:55:44 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:55:44 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:55:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Creating image(s)
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Ensure instance console log exists: /opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start _get_guest_xml network_info=[{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2485039-dabb-4fd6-85a3-2053001139e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0211892-4d87-4d0d-98ee-515eb41bc65b', 'serial': 'e0211892-4d87-4d0d-98ee-515eb41bc65b'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '5ca71cd0-9f6c-48d8-9b5c-bf2b07532757', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:55:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:55:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:55:45 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:55:45 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f65a47-efd4-4c21-a567-aabf154a34c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:55:45 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9bf31f-f147-496e-a17b-74e7b0d05c26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b] added
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3909f5b5-20e0-4d49-a449-a2cb3b0a1b4d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Took 0.50 seconds to deallocate network for instance.
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaca991-fb05-4200-8037-43931023421b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzeoqvOP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzeoqvOP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9679cb9-5b0d-4fbc-9452-0af645b45b30]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzeoqvOP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd5c8c-a6ee-4767-87ed-5934a963a6ee]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150fbb0-d382-4fc3-b17e-f155e8f254c8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3eb0d-00ed-4434-8ea7-94b29f3d5e1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]
Apr 12 07:55:45 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a96e21-71c3-41c8-85e8-162b95961c44]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe5b8b-728d-4057-93b4-8f66fa89e6e3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:55:45 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a42e0a-3dff-4ad4-8345-3317f6ee3751]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:45 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Deleted allocations for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43
Apr 12 07:55:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Acquiring lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Lock "611c996f-b32c-4d8f-86c5-b48e492c7d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] No waiting events found dispatching network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:46 user nova-compute[82850]: WARNING nova.compute.manager [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received unexpected event network-vif-plugged-9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance with vm_state deleted and task_state None.
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Received event network-vif-deleted-9a9860b6-35f6-4ce3-8509-6db0cd53c16e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23361306335356462', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361306335356462', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:55:46 user nova-compute[82850]:   <uuid>a2485039-dabb-4fd6-85a3-2053001139e4</uuid>
Apr 12 07:55:46 user nova-compute[82850]:   <name>instance-00000023</name>
Apr 12 07:55:46 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:55:46 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:55:46 user nova-compute[82850]:   <metadata>
Apr 12 07:55:46 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:55:46 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:55:46 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-453121416</nova:name>
Apr 12 07:55:46 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:55:45</nova:creationTime>
Apr 12 07:55:46 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:55:46 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:55:46 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:55:46 user nova-compute[82850]:       <nova:owner>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:55:46 user nova-compute[82850]:       </nova:owner>
Apr 12 07:55:46 user nova-compute[82850]:       <nova:ports>
Apr 12 07:55:46 user nova-compute[82850]:         <nova:port uuid="eeac49a6-c1b5-4fcd-9fae-4caa4f651618">
Apr 12 07:55:46 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 07:55:46 user nova-compute[82850]:         </nova:port>
Apr 12 07:55:46 user nova-compute[82850]:       </nova:ports>
Apr 12 07:55:46 user nova-compute[82850]:     </nova:instance>
Apr 12 07:55:46 user nova-compute[82850]:   </metadata>
Apr 12 07:55:46 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:55:46 user nova-compute[82850]:     <system>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="serial">a2485039-dabb-4fd6-85a3-2053001139e4</entry>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="uuid">a2485039-dabb-4fd6-85a3-2053001139e4</entry>
Apr 12 07:55:46 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:55:46 user nova-compute[82850]:     </system>
Apr 12 07:55:46 user nova-compute[82850]:   </sysinfo>
Apr 12 07:55:46 user nova-compute[82850]:   <os>
Apr 12 07:55:46 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:55:46 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:55:46 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:55:46 user nova-compute[82850]:   </os>
Apr 12 07:55:46 user nova-compute[82850]:   <features>
Apr 12 07:55:46 user nova-compute[82850]:     <acpi/>
Apr 12 07:55:46 user nova-compute[82850]:     <apic/>
Apr 12 07:55:46 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:55:46 user nova-compute[82850]:   </features>
Apr 12 07:55:46 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:55:46 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:55:46 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:55:46 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:55:46 user nova-compute[82850]:   </clock>
Apr 12 07:55:46 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:55:46 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:55:46 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:55:46 user nova-compute[82850]:   </cpu>
Apr 12 07:55:46 user nova-compute[82850]:   <devices>
Apr 12 07:55:46 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:55:46 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:55:46 user nova-compute[82850]:       <source dev="/dev/sdd"/>
Apr 12 07:55:46 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:55:46 user nova-compute[82850]:       <serial>e0211892-4d87-4d0d-98ee-515eb41bc65b</serial>
Apr 12 07:55:46 user nova-compute[82850]:     </disk>
Apr 12 07:55:46 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:55:46 user nova-compute[82850]:       <mac address="fa:16:3e:32:4d:25"/>
Apr 12 07:55:46 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:46 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:55:46 user nova-compute[82850]:       <target dev="tapeeac49a6-c1"/>
Apr 12 07:55:46 user nova-compute[82850]:     </interface>
Apr 12 07:55:46 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:55:46 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4/console.log" append="off"/>
Apr 12 07:55:46 user nova-compute[82850]:     </serial>
Apr 12 07:55:46 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:55:46 user nova-compute[82850]:     <video>
Apr 12 07:55:46 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:55:46 user nova-compute[82850]:     </video>
Apr 12 07:55:46 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:55:46 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:55:46 user nova-compute[82850]:     </rng>
Apr 12 07:55:46 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:55:46 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:55:46 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:55:46 user nova-compute[82850]:     </memballoon>
Apr 12 07:55:46 user nova-compute[82850]:   </devices>
Apr 12 07:55:46 user nova-compute[82850]: </domain>
Apr 12 07:55:46 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG os_vif [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeac49a6-c1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeac49a6-c1, col_values=(('external_ids', {'iface-id': 'eeac49a6-c1b5-4fcd-9fae-4caa4f651618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4d:25', 'vm-uuid': 'a2485039-dabb-4fd6-85a3-2053001139e4'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:46 user nova-compute[82850]: INFO os_vif [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1')
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:55:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:32:4d:25, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:55:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:48 user nova-compute[82850]: WARNING nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state building and task_state spawning.
Apr 12 07:55:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:55:48 user nova-compute[82850]: WARNING nova.compute.manager [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state building and task_state spawning.
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286149.8736842, a2485039-dabb-4fd6-85a3-2053001139e4 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] VM Resumed (Lifecycle Event)
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance spawned successfully.
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286149.8769448, a2485039-dabb-4fd6-85a3-2053001139e4 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] VM Started (Lifecycle Event)
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:55:49 user nova-compute[82850]: INFO nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Took 4.90 seconds to spawn the instance on the hypervisor.
Apr 12 07:55:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:55:50 user nova-compute[82850]: INFO nova.compute.manager [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Took 10.19 seconds to build instance.
Apr 12 07:55:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.303s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:55:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:55:59 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286144.6154494, 611c996f-b32c-4d8f-86c5-b48e492c7d43 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:55:59 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] VM Stopped (Lifecycle Event)
Apr 12 07:55:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e8f1da75-e580-4819-95d9-5a6407132696 None None] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 6f8d2d38-c98a-45d2-8829-e95e7cac030e {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 4dcaf13a-b6cd-4a95-92ec-febb027915d3 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 137c8fe9-a53f-4d00-84ed-63df965d3cb9 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid c2da4832-f77d-4e42-85f0-8e370c69f7b8 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:13 user nova-compute[82850]: INFO nova.compute.manager [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Terminating instance
Apr 12 07:56:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-unplugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:56:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Instance destroyed successfully.
Apr 12 07:56:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'resources' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-226648607',display_name='tempest-ServerRescueNegativeTestJSON-server-226648607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-226648607',id=3,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1c96acdf1f46f4b660de199d2b852b',ramdisk_id='',reservation_id='r-mxh96aw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1884068301',owner_user_name='tempest-ServerRescueNegativeTestJSON-1884068301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:46:04Z,user_data=None,user_id='86009132a34b466399da1701f47316d9',uuid=e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converting VIF {"id": "833dbd18-9190-4c45-8724-b57e1f46efcb", "address": "fa:16:3e:79:b2:43", "network": {"id": "0ce68a1e-e059-45d3-85f8-0efaeaf88149", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-878765832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1c96acdf1f46f4b660de199d2b852b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833dbd18-91", "ovs_interfaceid": "833dbd18-9190-4c45-8724-b57e1f46efcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG os_vif [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap833dbd18-91, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:56:14 user nova-compute[82850]: INFO os_vif [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:b2:43,bridge_name='br-int',has_traffic_filtering=True,id=833dbd18-9190-4c45-8724-b57e1f46efcb,network=Network(0ce68a1e-e059-45d3-85f8-0efaeaf88149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833dbd18-91')
Apr 12 07:56:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Deleting instance files /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2_del
Apr 12 07:56:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Deletion of /opt/stack/data/nova/instances/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2_del complete
Apr 12 07:56:14 user nova-compute[82850]: INFO nova.compute.manager [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 07:56:14 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:14 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Took 0.67 seconds to deallocate network for instance.
Apr 12 07:56:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-deleted-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:15 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Deleted allocations for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2
Apr 12 07:56:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.757s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Acquiring lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Lock "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] No waiting events found dispatching network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:15 user nova-compute[82850]: WARNING nova.compute.manager [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Received unexpected event network-vif-plugged-833dbd18-9190-4c45-8724-b57e1f46efcb for instance with vm_state deleted and task_state None.
Apr 12 07:56:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing instance network info cache due to event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Acquiring lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Acquired lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:56:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG nova.network.neutron [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updated VIF entry in instance network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG nova.network.neutron [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Releasing lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:26 user nova-compute[82850]: INFO nova.compute.manager [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Terminating instance
Apr 12 07:56:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:56:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Instance destroyed successfully.
Apr 12 07:56:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 137c8fe9-a53f-4d00-84ed-63df965d3cb9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing instance network info cache due to event network-changed-cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Acquiring lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Acquired lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Refreshing network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850084019',display_name='tempest-TestVolumeBootPattern-server-850084019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850084019',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-q8yy8ysk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:54:44Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=137c8fe9-a53f-4d00-84ed-63df965d3cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_vif [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc999de7-d1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:56:28 user nova-compute[82850]: INFO os_vif [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:9e:4e,bridge_name='br-int',has_traffic_filtering=True,id=cc999de7-d108-42bc-a880-e680f48b60c1,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc999de7-d1')
Apr 12 07:56:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:56:28 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=7921MB free_disk=26.132930755615234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpDFLYTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:56:28 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ef6e9-43f1-4800-948d-1f32cc242ec8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:56:28 user nova-compute[82850]: No targets found.
Apr 12 07:56:28 user nova-compute[82850]: iSNS:
Apr 12 07:56:28 user nova-compute[82850]: No targets found.
Apr 12 07:56:28 user nova-compute[82850]: STATIC:
Apr 12 07:56:28 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b
Apr 12 07:56:28 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:56:28 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:56:28 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:56:28 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:56:28 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:56:28 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:56:28 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:56:28 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:56:28 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b
Apr 12 07:56:28 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:56:28 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:56:28 user nova-compute[82850]: FIRMWARE:
Apr 12 07:56:28 user nova-compute[82850]: No targets found.
Apr 12 07:56:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:56:28 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:56:28 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884ef8e-2015-4d7d-ab2a-7677b7dd872b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3bc259-9eb5-402f-bec4-87faf9116ba8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:56:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b (non-flash)
Apr 12 07:56:28 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:56:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f19441dbeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c6b41-df64-4c50-993f-45d94c00c274]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bc267429-544b-4145-b4d9-8c2947c8c104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8ba0c-48f1-49f4-a41d-cfa72ddb57cd]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1dd63-bc48-4e35-bca5-20cbdae8ced8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce671c98-25a1-4a35-a7d7-3611d386f63a]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9edd3f-a664-4212-af6e-38fba5b2a6ad]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[39840837-dba6-44f8-9dd0-1c76de8d803b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260]
Apr 12 07:56:28 user nova-compute[82850]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b, portal: 172.16.0.220,3260] successful.
Apr 12 07:56:28 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b434b43-ce87-4cac-96e7-642f1686222b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306f8cb-eb42-4ccd-b13a-a0270869e941]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (331ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:56:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Deleting instance files /opt/stack/data/nova/instances/137c8fe9-a53f-4d00-84ed-63df965d3cb9_del
Apr 12 07:56:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Deletion of /opt/stack/data/nova/instances/137c8fe9-a53f-4d00-84ed-63df965d3cb9_del complete
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:28 user nova-compute[82850]: INFO nova.compute.manager [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Took 1.64 seconds to destroy the instance on the hypervisor.
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updated VIF entry in instance network info cache for port cc999de7-d108-42bc-a880-e680f48b60c1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [{"id": "cc999de7-d108-42bc-a880-e680f48b60c1", "address": "fa:16:3e:77:9e:4e", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc999de7-d1", "ovs_interfaceid": "cc999de7-d108-42bc-a880-e680f48b60c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Releasing lock "refresh_cache-137c8fe9-a53f-4d00-84ed-63df965d3cb9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-unplugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] No waiting events found dispatching network-vif-unplugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-unplugged-cc999de7-d108-42bc-a880-e680f48b60c1 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Acquiring lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] No waiting events found dispatching network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:28 user nova-compute[82850]: WARNING nova.compute.manager [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received unexpected event network-vif-plugged-cc999de7-d108-42bc-a880-e680f48b60c1 for instance with vm_state active and task_state deleting.
Apr 12 07:56:28 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286173.9844842, e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:56:28 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] VM Stopped (Lifecycle Event)
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a2485415-89d6-4433-bff4-0ba83119fa7f None None] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:29 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Took 0.82 seconds to deallocate network for instance.
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Received event network-vif-deleted-cc999de7-d108-42bc-a880-e680f48b60c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:29 user nova-compute[82850]: INFO nova.compute.manager [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Neutron deleted interface cc999de7-d108-42bc-a880-e680f48b60c1; detaching it from the instance and deleting it from the info cache
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.network.neutron [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Detach interface failed, port_id=cc999de7-d108-42bc-a880-e680f48b60c1, reason: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:56:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:56:30 user nova-compute[82850]: INFO nova.compute.manager [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 07:56:30 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.679s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:30 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9
Apr 12 07:56:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "137c8fe9-a53f-4d00-84ed-63df965d3cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.124s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:56:35 user nova-compute[82850]: INFO nova.compute.claims [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Claim successful on node user
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:56:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:35 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:56:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.policy [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:56:36 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Creating image(s)
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "/opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "/opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk 1073741824" returned: 0 in 0.047s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Successfully created port: de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Cannot resize image /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.objects.instance [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'migration_context' on Instance uuid b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Ensure instance console log exists: /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Successfully updated port: de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquired lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-changed-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Refreshing instance network info cache due to event network-changed-de07d79b-b05a-45d8-85ad-81cf9eb763d0. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Acquiring lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Updating instance_info_cache with network_info: [{"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Releasing lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Instance network_info: |[{"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Acquired lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.neutron [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Refreshing network info cache for port de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Start _get_guest_xml network_info=[{"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:56:37 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:56:37 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1612090880',display_name='tempest-VolumesActionsTest-instance-1612090880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1612090880',id=36,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-2amcnz9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:56:36Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.objects.instance [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'pci_devices' on Instance uuid b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:56:37 user nova-compute[82850]:   <uuid>b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd</uuid>
Apr 12 07:56:37 user nova-compute[82850]:   <name>instance-00000024</name>
Apr 12 07:56:37 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:56:37 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:56:37 user nova-compute[82850]:   <metadata>
Apr 12 07:56:37 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:56:37 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:name>tempest-VolumesActionsTest-instance-1612090880</nova:name>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:56:37</nova:creationTime>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:56:37 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:56:37 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:owner>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:user uuid="0758a81ac62548b1b39ab0487835c360">tempest-VolumesActionsTest-236815586-project-member</nova:user>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:project uuid="a1fd2e19a7d6462fbcfb1e4e7d46ac36">tempest-VolumesActionsTest-236815586</nova:project>
Apr 12 07:56:37 user nova-compute[82850]:       </nova:owner>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:56:37 user nova-compute[82850]:       <nova:ports>
Apr 12 07:56:37 user nova-compute[82850]:         <nova:port uuid="de07d79b-b05a-45d8-85ad-81cf9eb763d0">
Apr 12 07:56:37 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 07:56:37 user nova-compute[82850]:         </nova:port>
Apr 12 07:56:37 user nova-compute[82850]:       </nova:ports>
Apr 12 07:56:37 user nova-compute[82850]:     </nova:instance>
Apr 12 07:56:37 user nova-compute[82850]:   </metadata>
Apr 12 07:56:37 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:56:37 user nova-compute[82850]:     <system>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="serial">b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd</entry>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="uuid">b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd</entry>
Apr 12 07:56:37 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:56:37 user nova-compute[82850]:     </system>
Apr 12 07:56:37 user nova-compute[82850]:   </sysinfo>
Apr 12 07:56:37 user nova-compute[82850]:   <os>
Apr 12 07:56:37 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:56:37 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:56:37 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:56:37 user nova-compute[82850]:   </os>
Apr 12 07:56:37 user nova-compute[82850]:   <features>
Apr 12 07:56:37 user nova-compute[82850]:     <acpi/>
Apr 12 07:56:37 user nova-compute[82850]:     <apic/>
Apr 12 07:56:37 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:56:37 user nova-compute[82850]:   </features>
Apr 12 07:56:37 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:56:37 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:56:37 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:56:37 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:56:37 user nova-compute[82850]:   </clock>
Apr 12 07:56:37 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:56:37 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:56:37 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:56:37 user nova-compute[82850]:   </cpu>
Apr 12 07:56:37 user nova-compute[82850]:   <devices>
Apr 12 07:56:37 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 07:56:37 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 07:56:37 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk"/>
Apr 12 07:56:37 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:56:37 user nova-compute[82850]:     </disk>
Apr 12 07:56:37 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:56:37 user nova-compute[82850]:       <mac address="fa:16:3e:08:7f:a2"/>
Apr 12 07:56:37 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:56:37 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:56:37 user nova-compute[82850]:       <target dev="tapde07d79b-b0"/>
Apr 12 07:56:37 user nova-compute[82850]:     </interface>
Apr 12 07:56:37 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:56:37 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/console.log" append="off"/>
Apr 12 07:56:37 user nova-compute[82850]:     </serial>
Apr 12 07:56:37 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:56:37 user nova-compute[82850]:     <video>
Apr 12 07:56:37 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:56:37 user nova-compute[82850]:     </video>
Apr 12 07:56:37 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:56:37 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:56:37 user nova-compute[82850]:     </rng>
Apr 12 07:56:37 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:56:37 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:56:37 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:56:37 user nova-compute[82850]:     </memballoon>
Apr 12 07:56:37 user nova-compute[82850]:   </devices>
Apr 12 07:56:37 user nova-compute[82850]: </domain>
Apr 12 07:56:37 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1612090880',display_name='tempest-VolumesActionsTest-instance-1612090880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1612090880',id=36,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-2amcnz9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:56:36Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG os_vif [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde07d79b-b0, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde07d79b-b0, col_values=(('external_ids', {'iface-id': 'de07d79b-b05a-45d8-85ad-81cf9eb763d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:7f:a2', 'vm-uuid': 'b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:37 user nova-compute[82850]: INFO os_vif [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0')
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:56:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] No VIF found with MAC fa:16:3e:08:7f:a2, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:56:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Updated VIF entry in instance network info cache for port de07d79b-b05a-45d8-85ad-81cf9eb763d0. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:56:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Updating instance_info_cache with network_info: [{"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:56:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Releasing lock "refresh_cache-b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] No waiting events found dispatching network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:39 user nova-compute[82850]: WARNING nova.compute.manager [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received unexpected event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance with vm_state building and task_state spawning.
Apr 12 07:56:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286201.1866179, b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] VM Resumed (Lifecycle Event)
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Instance spawned successfully.
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286201.1908944, b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] VM Started (Lifecycle Event)
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Took 5.22 seconds to spawn the instance on the hypervisor.
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] No waiting events found dispatching network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:56:41 user nova-compute[82850]: WARNING nova.compute.manager [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received unexpected event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance with vm_state building and task_state spawning.
Apr 12 07:56:41 user nova-compute[82850]: INFO nova.compute.manager [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Took 5.87 seconds to build instance.
Apr 12 07:56:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.967s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:56:42 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286187.5506542, 137c8fe9-a53f-4d00-84ed-63df965d3cb9 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:56:42 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] VM Stopped (Lifecycle Event)
Apr 12 07:56:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f2668093-7ae9-4add-93b0-e74a03440401 None None] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:56:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:56:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:56:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:05 user nova-compute[82850]: INFO nova.compute.manager [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Attaching volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f to /dev/vdb
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.utils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[420eb2f4-fcbd-46c5-9fe2-771a8fec138f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ecc14b-6221-4672-bb95-61292b1ef02e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d98d0-3b16-4710-afd5-910b244f0ac4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f977943-6d69-4e4c-908e-056aeb386553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:57:05 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:57:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25654af-7662-4121-9401-74cee23fe4df]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG os_brick.utils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating existing volume attachment record: 36b9e650-57d3-4a8b-b6de-caff1f0ef409 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNLEsQzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:09 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25c8ba-5851-47ed-877d-12c512315386]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:57:09 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2623ea01-dd06-49e9-8473-d12d9f9dd07a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f] added
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[67119f85-78dc-494c-bf4f-ac43216d0761]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b936f098-108e-4782-9094-035f6bd399cf]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNLEsQzi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNLEsQzi" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd331742-7268-4b68-a49a-6ef26de7bd1e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNLEsQzi'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9933f16-0b84-47c8-9e3e-7df9fd9775fe]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c81ec-fb56-4ad6-947c-3edc3211ff23]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a2268-b584-48de-b758-a12c594f6bda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260]
Apr 12 07:57:09 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260] successful.
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a709b01-0508-4cc3-b16e-89b63bcf14a0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e002e48-719d-42bb-a7fc-859edd0ff46a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:09 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4f4b4-8283-4885-968c-2ddffb56014e]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNLEsQzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26265326466393532', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265326466393532', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 07:57:10 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:57:10 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:57:10 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:57:10 user nova-compute[82850]:   <serial>3a3299e9-bd95-4ab4-9424-716b655b0b2f</serial>
Apr 12 07:57:10 user nova-compute[82850]: </disk>
Apr 12 07:57:10 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 07:57:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:57:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:57:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] No VIF found with MAC fa:16:3e:0d:00:44, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:57:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.491s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:57:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-changed-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing instance network info cache due to event network-changed-277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:57:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:13 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:57:14 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updated VIF entry in instance network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:57:14 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:15 user nova-compute[82850]: INFO nova.compute.manager [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] instance snapshotting
Apr 12 07:57:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Beginning live snapshot process
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-changed-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing instance network info cache due to event network-changed-277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG nova.network.neutron [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0.delta 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0.delta 1073741824" returned: 0 in 0.051s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:16 user nova-compute[82850]: INFO nova.compute.manager [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Rebooting instance
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG nova.network.neutron [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updated VIF entry in instance network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG nova.network.neutron [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:57:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 07:57:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 07:57:17 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0.delta /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0.delta /opt/stack/data/nova/instances/snapshots/tmph9gd6ush/e8d52be8b4da4237a48446d4d1c0dfd0" returned: 0 in 0.413s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Snapshot extracted, beginning image upload
Apr 12 07:57:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:19 user nova-compute[82850]: WARNING nova.compute.manager [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state active and task_state reboot_started.
Apr 12 07:57:20 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance shutdown successfully.
Apr 12 07:57:20 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Snapshot image upload complete
Apr 12 07:57:20 user nova-compute[82850]: INFO nova.compute.manager [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Took 5.01 seconds to snapshot the instance on the hypervisor.
Apr 12 07:57:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:21 user nova-compute[82850]: WARNING nova.compute.manager [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state active and task_state reboot_started.
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing instance network info cache due to event network-changed-7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Acquiring lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Acquired lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Refreshing network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:22 user nova-compute[82850]: INFO nova.compute.manager [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Terminating instance
Apr 12 07:57:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updated VIF entry in instance network info cache for port 7406406c-e3a5-4cf8-9cd4-3352be7a2f09. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating instance_info_cache with network_info: [{"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Releasing lock "refresh_cache-6f8d2d38-c98a-45d2-8829-e95e7cac030e" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Instance destroyed successfully.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lazy-loading 'resources' on Instance uuid 6f8d2d38-c98a-45d2-8829-e95e7cac030e {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:52:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526182795',display_name='tempest-TestVolumeBootPattern-server-526182795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526182795',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ==',key_name='tempest-TestVolumeBootPattern-1580615295',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='145931c86ba9489684b6eabb936b9738',ramdisk_id='',reservation_id='r-ss3wj0oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11493924',owner_user_name='tempest-TestVolumeBootPattern-11493924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:52:48Z,user_data=None,user_id='71763ade39bb43eb947ea6f175ce68c1',uuid=6f8d2d38-c98a-45d2-8829-e95e7cac030e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converting VIF {"id": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "address": "fa:16:3e:54:c4:1d", "network": {"id": "75249366-198a-45a1-8aa1-05694b14476d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1226024197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "145931c86ba9489684b6eabb936b9738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7406406c-e3", "ovs_interfaceid": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_vif [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7406406c-e3, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:57:23 user nova-compute[82850]: INFO os_vif [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c4:1d,bridge_name='br-int',has_traffic_filtering=True,id=7406406c-e3a5-4cf8-9cd4-3352be7a2f09,network=Network(75249366-198a-45a1-8aa1-05694b14476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7406406c-e3')
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQkbYjeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[681aa241-4d94-406a-a02b-30b638d33e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:57:23 user nova-compute[82850]: No targets found.
Apr 12 07:57:23 user nova-compute[82850]: iSNS:
Apr 12 07:57:23 user nova-compute[82850]: No targets found.
Apr 12 07:57:23 user nova-compute[82850]: STATIC:
Apr 12 07:57:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f
Apr 12 07:57:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f
Apr 12 07:57:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:57:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b
Apr 12 07:57:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:23 user nova-compute[82850]: FIRMWARE:
Apr 12 07:57:23 user nova-compute[82850]: No targets found.
Apr 12 07:57:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:57:23 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:57:23 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f127a058-1da4-4717-bfc8-cd93b8e4c624]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e4fab4-3289-47c8-82e7-383f66ea5327]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:23 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0f4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86028f24-28fc-4c94-992a-1a8615c66812]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3158c83-af40-493c-a110-89088a87ce3f]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7625fd18-67e8-4aca-8018-feecff213376]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13bd62b-6e6b-4303-9602-5027952ea147]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d4abfce4', '/dev/disk/by-id/scsi-26366643132653666', '/dev/disk/by-id/scsi-1SCST_BIOd4abfce4-cfd12e6f3858d69a') {{(pid=93535) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[261dcef9-7d37-4745-98bc-a08966b936b6]: (4, None) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1b713-64a6-46c2-bcbb-d27e329b93cc]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88725c19-dc30-48a5-89c3-422be315657c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260]
Apr 12 07:57:23 user nova-compute[82850]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f, portal: 172.16.0.220,3260] successful.
Apr 12 07:57:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe954cd5-982e-420d-b3e2-6da8bff98d9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e0203-92ab-4108-81bf-6998d39380f9]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] <== disconnect_volume: return (359ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Deleting instance files /opt/stack/data/nova/instances/6f8d2d38-c98a-45d2-8829-e95e7cac030e_del
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Deletion of /opt/stack/data/nova/instances/6f8d2d38-c98a-45d2-8829-e95e7cac030e_del complete
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.compute.manager [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:23 user nova-compute[82850]: WARNING nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state active and task_state reboot_started.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:23 user nova-compute[82850]: WARNING nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state active and task_state reboot_started.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-unplugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] No waiting events found dispatching network-vif-unplugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-unplugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Acquiring lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] No waiting events found dispatching network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:23 user nova-compute[82850]: WARNING nova.compute.manager [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received unexpected event network-vif-plugged-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance with vm_state active and task_state deleting.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for bc267429-544b-4145-b4d9-8c2947c8c104 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286243.937299, bc267429-544b-4145-b4d9-8c2947c8c104 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] VM Resumed (Lifecycle Event)
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance running successfully.
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance soft rebooted successfully.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 07:57:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286243.9394507, bc267429-544b-4145-b4d9-8c2947c8c104 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:57:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] VM Started (Lifecycle Event)
Apr 12 07:57:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.674s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:57:24 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:24 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Took 0.60 seconds to deallocate network for instance.
Apr 12 07:57:25 user nova-compute[82850]: INFO nova.compute.manager [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Took 1.12 seconds to detach 1 volumes for instance.
Apr 12 07:57:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:25 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:57:25 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:57:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Received event network-vif-deleted-7406406c-e3a5-4cf8-9cd4-3352be7a2f09 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:25 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Deleted allocations for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e
Apr 12 07:57:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "6f8d2d38-c98a-45d2-8829-e95e7cac030e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.496s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:26 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:57:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:57:29 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:57:29 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=26.073657989501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bc267429-544b-4145-b4d9-8c2947c8c104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:57:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:57:30 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:57:30 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:57:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:57:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing instance network info cache due to event network-changed-2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Acquiring lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Acquired lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG nova.network.neutron [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Refreshing network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:32 user nova-compute[82850]: DEBUG nova.network.neutron [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updated VIF entry in instance network info cache for port 2bf3e827-1777-48cf-a8fc-0eeff964afe7. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:57:32 user nova-compute[82850]: DEBUG nova.network.neutron [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Releasing lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Stashing vm_state: active {{(pid=82850) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_requests' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:57:33 user nova-compute[82850]: INFO nova.compute.claims [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Claim successful on node user
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'pci_devices' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-changed-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Refreshing instance network info cache due to event network-changed-eeac49a6-c1b5-4fcd-9fae-4caa4f651618. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Refreshing network info cache for port eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:57:33 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating resource usage from migration 4da7d878-3efb-4a27-9bff-eb6f60b4d737
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.421s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:33 user nova-compute[82850]: INFO nova.compute.manager [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Migrating
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updated VIF entry in instance network info cache for port eeac49a6-c1b5-4fcd-9fae-4caa4f651618. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.network.neutron [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Starting migrate_disk_and_power_off {{(pid=82850) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:35 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance destroyed successfully.
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeac49a6-c1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:57:35 user nova-compute[82850]: INFO os_vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1')
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:35 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd1fdcd-320b-4c26-a432-125e08915b39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:57:35 user nova-compute[82850]: No targets found.
Apr 12 07:57:35 user nova-compute[82850]: iSNS:
Apr 12 07:57:35 user nova-compute[82850]: No targets found.
Apr 12 07:57:35 user nova-compute[82850]: STATIC:
Apr 12 07:57:35 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f
Apr 12 07:57:35 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:35 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:35 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:57:35 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:35 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:35 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b
Apr 12 07:57:35 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:57:35 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:57:35 user nova-compute[82850]: FIRMWARE:
Apr 12 07:57:35 user nova-compute[82850]: No targets found.
Apr 12 07:57:35 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:57:35 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:57:35 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3547b9-fed0-47ad-bff2-c5116ceeb738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86001da5-9f4f-4a56-b9d7-183eec61e99f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:35 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:35 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:35 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:35 user nova-compute[82850]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:35 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:35 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c315240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b'): ({'sdd'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdd {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b45fb55-97f8-4ecb-8d99-81c0372ef482]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:35 user nova-compute[82850]: WARNING nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state active and task_state resize_migrating.
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:35 user nova-compute[82850]: WARNING nova.compute.manager [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state active and task_state resize_migrating.
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2aaed1-8f36-48ed-859a-b56afa419bdc]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdd {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[661308b0-9f3e-4b14-8ccb-19443ab68276]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aee8d5-5330-493e-9572-3ae49c1e55ff]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23361306335356462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_983d2ea8', '/dev/disk/by-id/scsi-1SCST_BIO983d2ea8-3a0c55dbcda11bea') {{(pid=93535) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc493d6-fc8b-4c50-9ca9-a4085084ad6d]: (4, None) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b568ddf-2c49-43e1-a45d-510d62717da6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98302026-e0f7-4b86-a569-b14026b7a161]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]
Apr 12 07:57:35 user nova-compute[82850]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.
Apr 12 07:57:35 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3ca18f-8c34-4860-a3fb-8b51dc433d54]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (348ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:57:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Port eeac49a6-c1b5-4fcd-9fae-4caa4f651618 binding to destination host user is already ACTIVE {{(pid=82850) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:57:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.utils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f718e-b7af-493f-bac2-dfcc8ea17f27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f990a-0c82-40ea-aa88-075e6498d796]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d8520-d3e0-4c52-9ce1-88fba1c08850]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0079e2-5ac4-405d-949b-c3032ece6d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:57:37 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:57:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[075512b3-d7bc-4baf-b5e6-1a8036ea4b30]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:57:37 user nova-compute[82850]: DEBUG os_brick.utils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:38 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286243.322717, 6f8d2d38-c98a-45d2-8829-e95e7cac030e => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:57:38 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] VM Stopped (Lifecycle Event)
Apr 12 07:57:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-39f25b4c-26a1-4993-beb8-795320a35706 None None] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Starting finish_migration {{(pid=82850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 07:57:41 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Creating image(s)
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Ensure instance console log exists: /opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start _get_guest_xml network_info=[{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a2485039-dabb-4fd6-85a3-2053001139e4', 'attached_at': '2023-04-12T07:57:42.000000', 'detached_at': '', 'volume_id': 'e0211892-4d87-4d0d-98ee-515eb41bc65b', 'serial': 'e0211892-4d87-4d0d-98ee-515eb41bc65b'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '34967c54-f0a5-47d2-beff-864bfccf1116', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:57:41 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:57:41 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.objects.instance [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:57:41 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:41 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:57:41 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe4ab9-9f7c-49bb-9649-1927bfd110a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:57:41 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02bb92-94e6-4a3d-9523-8123356d3932]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b] added
Apr 12 07:57:41 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f05535-3772-42e2-95c0-2494551274cb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705635f-5661-4d6a-af52-ed3c3b8180a3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzeoqvOP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzeoqvOP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454c3c6-24f2-432d-b795-e947b1e80d19]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzeoqvOP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed7be9-ea53-440e-b9ec-55f3c04f3cdb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f9d8e-35fe-4463-b98e-f10392af91be]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:41 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:41 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:41 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:41 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85c8c63-0cc1-4bba-a991-482a773a3836]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]
Apr 12 07:57:41 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.
Apr 12 07:57:41 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4214ca4-0c57-46a2-a3ff-3ffd89f5dcbc]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:57:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[632be9d0-1027-4057-94f8-069c0a466286]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:42 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:42 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:57:42 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:57:42 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:57:42 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a745b-76d6-44b8-bff1-e87b40d1658f]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:57:42 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23361306335356462', 'path': '/dev/sdc'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361306335356462', 'path': '/dev/sdc'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:57:43 user nova-compute[82850]:   <uuid>a2485039-dabb-4fd6-85a3-2053001139e4</uuid>
Apr 12 07:57:43 user nova-compute[82850]:   <name>instance-00000023</name>
Apr 12 07:57:43 user nova-compute[82850]:   <memory>196608</memory>
Apr 12 07:57:43 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:57:43 user nova-compute[82850]:   <metadata>
Apr 12 07:57:43 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:57:43 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:57:43 user nova-compute[82850]:       <nova:name>tempest-ServerActionsTestJSON-server-453121416</nova:name>
Apr 12 07:57:43 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:57:41</nova:creationTime>
Apr 12 07:57:43 user nova-compute[82850]:       <nova:flavor name="m1.micro">
Apr 12 07:57:43 user nova-compute[82850]:         <nova:memory>192</nova:memory>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:57:43 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:57:43 user nova-compute[82850]:       <nova:owner>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:user uuid="c21b45cf78564f5092726eaeac38675e">tempest-ServerActionsTestJSON-836808185-project-member</nova:user>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:project uuid="1e0323c8eafc4012883daccef045d4a5">tempest-ServerActionsTestJSON-836808185</nova:project>
Apr 12 07:57:43 user nova-compute[82850]:       </nova:owner>
Apr 12 07:57:43 user nova-compute[82850]:       <nova:ports>
Apr 12 07:57:43 user nova-compute[82850]:         <nova:port uuid="eeac49a6-c1b5-4fcd-9fae-4caa4f651618">
Apr 12 07:57:43 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 07:57:43 user nova-compute[82850]:         </nova:port>
Apr 12 07:57:43 user nova-compute[82850]:       </nova:ports>
Apr 12 07:57:43 user nova-compute[82850]:     </nova:instance>
Apr 12 07:57:43 user nova-compute[82850]:   </metadata>
Apr 12 07:57:43 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:57:43 user nova-compute[82850]:     <system>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="serial">a2485039-dabb-4fd6-85a3-2053001139e4</entry>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="uuid">a2485039-dabb-4fd6-85a3-2053001139e4</entry>
Apr 12 07:57:43 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:57:43 user nova-compute[82850]:     </system>
Apr 12 07:57:43 user nova-compute[82850]:   </sysinfo>
Apr 12 07:57:43 user nova-compute[82850]:   <os>
Apr 12 07:57:43 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:57:43 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:57:43 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:57:43 user nova-compute[82850]:   </os>
Apr 12 07:57:43 user nova-compute[82850]:   <features>
Apr 12 07:57:43 user nova-compute[82850]:     <acpi/>
Apr 12 07:57:43 user nova-compute[82850]:     <apic/>
Apr 12 07:57:43 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:57:43 user nova-compute[82850]:   </features>
Apr 12 07:57:43 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:57:43 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:57:43 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:57:43 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:57:43 user nova-compute[82850]:   </clock>
Apr 12 07:57:43 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:57:43 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:57:43 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:57:43 user nova-compute[82850]:   </cpu>
Apr 12 07:57:43 user nova-compute[82850]:   <devices>
Apr 12 07:57:43 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:57:43 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:57:43 user nova-compute[82850]:       <source dev="/dev/sdc"/>
Apr 12 07:57:43 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:57:43 user nova-compute[82850]:       <serial>e0211892-4d87-4d0d-98ee-515eb41bc65b</serial>
Apr 12 07:57:43 user nova-compute[82850]:     </disk>
Apr 12 07:57:43 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:57:43 user nova-compute[82850]:       <mac address="fa:16:3e:32:4d:25"/>
Apr 12 07:57:43 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:57:43 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:57:43 user nova-compute[82850]:       <target dev="tapeeac49a6-c1"/>
Apr 12 07:57:43 user nova-compute[82850]:     </interface>
Apr 12 07:57:43 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:57:43 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4/console.log" append="off"/>
Apr 12 07:57:43 user nova-compute[82850]:     </serial>
Apr 12 07:57:43 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:57:43 user nova-compute[82850]:     <video>
Apr 12 07:57:43 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:57:43 user nova-compute[82850]:     </video>
Apr 12 07:57:43 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:57:43 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:57:43 user nova-compute[82850]:     </rng>
Apr 12 07:57:43 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:57:43 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:57:43 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:57:43 user nova-compute[82850]:     </memballoon>
Apr 12 07:57:43 user nova-compute[82850]:   </devices>
Apr 12 07:57:43 user nova-compute[82850]: </domain>
Apr 12 07:57:43 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1967243571-network", "vif_mac": "fa:16:3e:32:4d:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG os_vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeac49a6-c1, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeac49a6-c1, col_values=(('external_ids', {'iface-id': 'eeac49a6-c1b5-4fcd-9fae-4caa4f651618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4d:25', 'vm-uuid': 'a2485039-dabb-4fd6-85a3-2053001139e4'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:43 user nova-compute[82850]: INFO os_vif [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1')
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:57:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] No VIF found with MAC fa:16:3e:32:4d:25, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:44 user nova-compute[82850]: WARNING nova.compute.manager [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state active and task_state resize_finish.
Apr 12 07:57:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for a2485039-dabb-4fd6-85a3-2053001139e4 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286266.5219042, a2485039-dabb-4fd6-85a3-2053001139e4 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:57:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] VM Resumed (Lifecycle Event)
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:57:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance running successfully.
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Failed to set time: agent not configured {{(pid=82850) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] finish_migration finished successfully. {{(pid=82850) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:57:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286266.5234563, a2485039-dabb-4fd6-85a3-2053001139e4 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:57:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] VM Started (Lifecycle Event)
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:57:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:57:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:57:46 user nova-compute[82850]: WARNING nova.compute.manager [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state active and task_state resize_finish.
Apr 12 07:57:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:57:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:58:22 user nova-compute[82850]: INFO nova.compute.claims [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Claim successful on node user
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:58:22 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:58:22 user nova-compute[82850]: INFO nova.virt.block_device [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Booting with volume-backed-image 68a0a523-85da-4c40-ac88-5d5f304c0b18 at /dev/vda
Apr 12 07:58:22 user nova-compute[82850]: DEBUG nova.policy [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:58:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Successfully created port: 73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Successfully updated port: 73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-changed-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.compute.manager [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Refreshing instance network info cache due to event network-changed-73e030f7-fd13-48ad-9868-9eff44bd7719. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Acquiring lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance network_info: |[{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Acquired lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:58:24 user nova-compute[82850]: DEBUG nova.network.neutron [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Refreshing network info cache for port 73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:58:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updated VIF entry in instance network info cache for port 73e030f7-fd13-48ad-9868-9eff44bd7719. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:58:25 user nova-compute[82850]: DEBUG nova.network.neutron [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:58:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Releasing lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:26 user nova-compute[82850]: INFO nova.compute.manager [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Terminating instance
Apr 12 07:58:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-unplugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] No waiting events found dispatching network-vif-unplugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:58:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-unplugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:58:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Instance destroyed successfully.
Apr 12 07:58:26 user nova-compute[82850]: DEBUG nova.objects.instance [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lazy-loading 'resources' on Instance uuid b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1612090880',display_name='tempest-VolumesActionsTest-instance-1612090880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1612090880',id=36,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:56:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1fd2e19a7d6462fbcfb1e4e7d46ac36',ramdisk_id='',reservation_id='r-2amcnz9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-236815586',owner_user_name='tempest-VolumesActionsTest-236815586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:56:41Z,user_data=None,user_id='0758a81ac62548b1b39ab0487835c360',uuid=b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converting VIF {"id": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "address": "fa:16:3e:08:7f:a2", "network": {"id": "c16bc06c-152b-4927-af6e-83ea43e8913e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-975355902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1fd2e19a7d6462fbcfb1e4e7d46ac36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde07d79b-b0", "ovs_interfaceid": "de07d79b-b05a-45d8-85ad-81cf9eb763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG os_vif [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde07d79b-b0, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:58:27 user nova-compute[82850]: INFO os_vif [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:7f:a2,bridge_name='br-int',has_traffic_filtering=True,id=de07d79b-b05a-45d8-85ad-81cf9eb763d0,network=Network(c16bc06c-152b-4927-af6e-83ea43e8913e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde07d79b-b0')
Apr 12 07:58:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Deleting instance files /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd_del
Apr 12 07:58:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Deletion of /opt/stack/data/nova/instances/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd_del complete
Apr 12 07:58:27 user nova-compute[82850]: INFO nova.compute.manager [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 12 07:58:27 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:58:27 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Took 0.55 seconds to deallocate network for instance.
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-deleted-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:27 user nova-compute[82850]: INFO nova.compute.manager [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Neutron deleted interface de07d79b-b05a-45d8-85ad-81cf9eb763d0; detaching it from the instance and deleting it from the info cache
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.network.neutron [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Detach interface failed, port_id=de07d79b-b05a-45d8-85ad-81cf9eb763d0, reason: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:58:27 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:28 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Deleted allocations for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.763s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.utils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8440b3e9-e890-47be-8c57-aa006a86c3ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a9f19-8ee4-44f8-a350-b5c2f33e90f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9133ef08-f8a5-4856-9829-112b431fc21f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a98e58-fe36-4736-b1ef-db70e2d8c6ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Acquiring lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Lock "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] No waiting events found dispatching network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:58:28 user nova-compute[82850]: WARNING nova.compute.manager [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Received unexpected event network-vif-plugged-de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance with vm_state deleted and task_state None.
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:58:28 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[293fdb54-72ed-4f93-8979-35e0a77d880c]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG os_brick.utils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating existing volume attachment record: 5aa7406e-97fa-4ca1-a73f-485cc87f7528 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:58:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:58:30 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:58:30 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=26.064990997314453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Applying migration context for instance a2485039-dabb-4fd6-85a3-2053001139e4 as it has an incoming, in-progress migration 4da7d878-3efb-4a27-9bff-eb6f60b4d737. Migration status is finished {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 07:58:30 user nova-compute[82850]: INFO nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating resource usage from migration 4da7d878-3efb-4a27-9bff-eb6f60b4d737
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bc267429-544b-4145-b4d9-8c2947c8c104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Migration 4da7d878-3efb-4a27-9bff-eb6f60b4d737 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:58:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:58:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:31 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:58:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:58:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:58:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Skipping network cache update for instance because it is Building. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:58:33 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Creating image(s)
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Ensure instance console log exists: /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start _get_guest_xml network_info=[{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '097391de-d8e8-4023-b839-a306aedfb0b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'serial': 'ff4a08c6-c0b2-4ee6-aac1-3000541c8e35'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '5aa7406e-97fa-4ca1-a73f-485cc87f7528', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:58:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:58:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:58:33 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:58:33 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:58:33 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df113a81-ef91-4705-9e7c-09b3ec01f02a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:58:33 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204b235-2f40-4c97-a207-177a0a3aa933]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35] added
Apr 12 07:58:33 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1babae-b006-4d7b-84d2-512307cfad3d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceeaad1-03de-4cd8-b937-e0725dafe070]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZERbJoM {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZERbJoM" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd937930-4f1e-4f50-a8b8-7d7ec6156752]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZERbJoM'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae932a9-a22a-414c-85a9-68dfebf4f930]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06efa425-c111-409c-b6c2-435470f13f69]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:58:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:58:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd36d4-683d-4d53-92f9-b72d713eb240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260]
Apr 12 07:58:34 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260] successful.
Apr 12 07:58:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea131d2-0b8e-498d-b34b-d3dad823a4e7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a775d0-3a3c-4d68-86b8-9451e9bdff16]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:58:34 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 07:58:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e66f97-ae89-4365-b1c1-35c065aee8d4]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:58:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23864383163343866', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864383163343866', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-361817046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-361817046',id=37,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-vazfdg0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:58:23Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=097391de-d8e8-4023-b839-a306aedfb0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:58:35 user nova-compute[82850]:   <uuid>097391de-d8e8-4023-b839-a306aedfb0b2</uuid>
Apr 12 07:58:35 user nova-compute[82850]:   <name>instance-00000025</name>
Apr 12 07:58:35 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 07:58:35 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 07:58:35 user nova-compute[82850]:   <metadata>
Apr 12 07:58:35 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:58:35 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-361817046</nova:name>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:creationTime>2023-04-12 07:58:33</nova:creationTime>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 07:58:35 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:58:35 user nova-compute[82850]:       </nova:flavor>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:owner>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 07:58:35 user nova-compute[82850]:       </nova:owner>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 07:58:35 user nova-compute[82850]:       <nova:ports>
Apr 12 07:58:35 user nova-compute[82850]:         <nova:port uuid="73e030f7-fd13-48ad-9868-9eff44bd7719">
Apr 12 07:58:35 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:58:35 user nova-compute[82850]:         </nova:port>
Apr 12 07:58:35 user nova-compute[82850]:       </nova:ports>
Apr 12 07:58:35 user nova-compute[82850]:     </nova:instance>
Apr 12 07:58:35 user nova-compute[82850]:   </metadata>
Apr 12 07:58:35 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 07:58:35 user nova-compute[82850]:     <system>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="serial">097391de-d8e8-4023-b839-a306aedfb0b2</entry>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="uuid">097391de-d8e8-4023-b839-a306aedfb0b2</entry>
Apr 12 07:58:35 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:58:35 user nova-compute[82850]:     </system>
Apr 12 07:58:35 user nova-compute[82850]:   </sysinfo>
Apr 12 07:58:35 user nova-compute[82850]:   <os>
Apr 12 07:58:35 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:58:35 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 07:58:35 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 07:58:35 user nova-compute[82850]:   </os>
Apr 12 07:58:35 user nova-compute[82850]:   <features>
Apr 12 07:58:35 user nova-compute[82850]:     <acpi/>
Apr 12 07:58:35 user nova-compute[82850]:     <apic/>
Apr 12 07:58:35 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 07:58:35 user nova-compute[82850]:   </features>
Apr 12 07:58:35 user nova-compute[82850]:   <clock offset="utc">
Apr 12 07:58:35 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:58:35 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:58:35 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 07:58:35 user nova-compute[82850]:   </clock>
Apr 12 07:58:35 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 07:58:35 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 07:58:35 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:58:35 user nova-compute[82850]:   </cpu>
Apr 12 07:58:35 user nova-compute[82850]:   <devices>
Apr 12 07:58:35 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 07:58:35 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:58:35 user nova-compute[82850]:       <source dev="/dev/sdd"/>
Apr 12 07:58:35 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 07:58:35 user nova-compute[82850]:       <serial>ff4a08c6-c0b2-4ee6-aac1-3000541c8e35</serial>
Apr 12 07:58:35 user nova-compute[82850]:     </disk>
Apr 12 07:58:35 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 07:58:35 user nova-compute[82850]:       <mac address="fa:16:3e:c2:53:64"/>
Apr 12 07:58:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:58:35 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 07:58:35 user nova-compute[82850]:       <target dev="tap73e030f7-fd"/>
Apr 12 07:58:35 user nova-compute[82850]:     </interface>
Apr 12 07:58:35 user nova-compute[82850]:     <serial type="pty">
Apr 12 07:58:35 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/console.log" append="off"/>
Apr 12 07:58:35 user nova-compute[82850]:     </serial>
Apr 12 07:58:35 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:58:35 user nova-compute[82850]:     <video>
Apr 12 07:58:35 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 07:58:35 user nova-compute[82850]:     </video>
Apr 12 07:58:35 user nova-compute[82850]:     <rng model="virtio">
Apr 12 07:58:35 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:58:35 user nova-compute[82850]:     </rng>
Apr 12 07:58:35 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:58:35 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 07:58:35 user nova-compute[82850]:       <stats period="10"/>
Apr 12 07:58:35 user nova-compute[82850]:     </memballoon>
Apr 12 07:58:35 user nova-compute[82850]:   </devices>
Apr 12 07:58:35 user nova-compute[82850]: </domain>
Apr 12 07:58:35 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-361817046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-361817046',id=37,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-vazfdg0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:58:23Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=097391de-d8e8-4023-b839-a306aedfb0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG os_vif [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73e030f7-fd, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73e030f7-fd, col_values=(('external_ids', {'iface-id': '73e030f7-fd13-48ad-9868-9eff44bd7719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:53:64', 'vm-uuid': '097391de-d8e8-4023-b839-a306aedfb0b2'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:35 user nova-compute[82850]: INFO os_vif [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd')
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:58:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:c2:53:64, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:58:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:58:37 user nova-compute[82850]: WARNING nova.compute.manager [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state building and task_state spawning.
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286318.6713157, 097391de-d8e8-4023-b839-a306aedfb0b2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Resumed (Lifecycle Event)
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance spawned successfully.
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286318.675436, 097391de-d8e8-4023-b839-a306aedfb0b2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Started (Lifecycle Event)
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Took 5.04 seconds to spawn the instance on the hypervisor.
Apr 12 07:58:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:58:38 user nova-compute[82850]: INFO nova.compute.manager [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Took 16.53 seconds to build instance.
Apr 12 07:58:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.662s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:58:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:58:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:58:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:58:39 user nova-compute[82850]: DEBUG nova.compute.manager [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:58:39 user nova-compute[82850]: WARNING nova.compute.manager [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state None.
Apr 12 07:58:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:41 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286306.987709, b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:58:41 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] VM Stopped (Lifecycle Event)
Apr 12 07:58:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f25af7be-f777-410b-9ab3-702312cbc43d None None] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:58:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:58:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-changed-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:59:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing instance network info cache due to event network-changed-277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:59:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:59:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:59:07 user nova-compute[82850]: DEBUG nova.network.neutron [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updated VIF entry in instance network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-changed-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing instance network info cache due to event network-changed-277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Acquiring lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Acquired lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Refreshing network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:59:08 user nova-compute[82850]: INFO nova.compute.manager [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Detaching volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f
Apr 12 07:59:08 user nova-compute[82850]: INFO nova.virt.block_device [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Attempting to driver detach volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f from mountpoint /dev/vdb
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Attempting to detach device vdb from instance bc267429-544b-4145-b4d9-8c2947c8c104 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:59:08 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:59:08 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:59:08 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:59:08 user nova-compute[82850]:   <serial>3a3299e9-bd95-4ab4-9424-716b655b0b2f</serial>
Apr 12 07:59:08 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:59:08 user nova-compute[82850]: </disk>
Apr 12 07:59:08 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:59:08 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully detached device vdb from instance bc267429-544b-4145-b4d9-8c2947c8c104 from the persistent domain config.
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc267429-544b-4145-b4d9-8c2947c8c104 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 07:59:08 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:59:08 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 07:59:08 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 07:59:08 user nova-compute[82850]:   <serial>3a3299e9-bd95-4ab4-9424-716b655b0b2f</serial>
Apr 12 07:59:08 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 07:59:08 user nova-compute[82850]: </disk>
Apr 12 07:59:08 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updated VIF entry in instance network info cache for port 277f41f9-00ba-4f58-9186-da42879de40e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [{"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:59:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Releasing lock "refresh_cache-bc267429-544b-4145-b4d9-8c2947c8c104" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681286349.1535144, bc267429-544b-4145-b4d9-8c2947c8c104 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 07:59:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully detached device vdb from instance bc267429-544b-4145-b4d9-8c2947c8c104 from the live domain config.
Apr 12 07:59:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNLEsQzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:59:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24fed27-16b6-4a81-892f-938d2a9e2bc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:59:09 user nova-compute[82850]: No targets found.
Apr 12 07:59:09 user nova-compute[82850]: iSNS:
Apr 12 07:59:09 user nova-compute[82850]: No targets found.
Apr 12 07:59:09 user nova-compute[82850]: STATIC:
Apr 12 07:59:09 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f
Apr 12 07:59:09 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:59:09 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:59:09 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35
Apr 12 07:59:09 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:59:09 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:59:09 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 07:59:09 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:59:09 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:59:09 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b
Apr 12 07:59:09 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:59:09 user nova-compute[82850]:                 Iface Name: default
Apr 12 07:59:09 user nova-compute[82850]: FIRMWARE:
Apr 12 07:59:09 user nova-compute[82850]: No targets found.
Apr 12 07:59:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:59:09 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:59:09 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94bc35-c57f-44cb-9d9e-22dc9dd60f40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a417a26-45d8-4ae6-9a7c-0435fd768b45]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 07:59:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 07:59:09 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 07:59:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f19342ca200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae63996-1682-4836-b68b-8a0ee571b241]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1fb16c-9722-4272-8fca-17a60db7bf3d]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d0be7-e696-42a5-bc17-784a7d6cc174]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b107248-70c5-4606-bd2a-7c52ebb85035]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d068cc-8296-4d35-bb06-c94ff38e170b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01763c-eba9-4f93-b7b3-6d81b9ad4b5a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260]
Apr 12 07:59:09 user nova-compute[82850]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f, portal: 172.16.0.220,3260] successful.
Apr 12 07:59:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3299e9-bd95-4ab4-9424-716b655b0b2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a4c490-7444-4726-9323-d9398f00bf6a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] <== disconnect_volume: return (319ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:59:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:59:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'flavor' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:59:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:59:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:59:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Going to confirm migration 2 {{(pid=82850) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquired lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:59:22 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'info_cache' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [{"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Releasing lock "refresh_cache-a2485039-dabb-4fd6-85a3-2053001139e4" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'migration_context' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:59:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.333s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:59:23 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Deleted allocation for migration 4da7d878-3efb-4a27-9bff-eb6f60b4d737
Apr 12 07:59:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.195s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:59:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:59:28 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:59:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:30 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:59:30 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.822410583496094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance bc267429-544b-4145-b4d9-8c2947c8c104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:59:30 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:59:31 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:59:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:59:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:59:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:59:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:59:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:59:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:59:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:59:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:01 user nova-compute[82850]: INFO nova.compute.manager [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Terminating instance
Apr 12 08:00:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:01 user nova-compute[82850]: DEBUG nova.compute.manager [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-unplugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Instance destroyed successfully.
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'resources' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1719272565',display_name='tempest-TestMinimumBasicScenario-server-1719272565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1719272565',id=33,image_ref='27758478-87f6-46a9-8895-882f41f56ed8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsJMgKR2OtLfQZhgaJUVQq7Qz6EmW1x26YrHrFvEapwB9N+yzYyW5wym/7oCwnZlsj89EtVjI1kDh92fCOQewJ9CfY+dmGsR7zSXq+UfbqqLPcqsbhfRlDZHAL5iHXXsg==',key_name='tempest-TestMinimumBasicScenario-623587583',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f4f7b1930e48cb82f5f6010872e221',ramdisk_id='',reservation_id='r-zl5foksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27758478-87f6-46a9-8895-882f41f56ed8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1759703879',owner_user_name='tempest-TestMinimumBasicScenario-1759703879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:57:24Z,user_data=None,user_id='630f8381d3534fd3a1978fc0a931e8c0',uuid=bc267429-544b-4145-b4d9-8c2947c8c104,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converting VIF {"id": "277f41f9-00ba-4f58-9186-da42879de40e", "address": "fa:16:3e:0d:00:44", "network": {"id": "8d582cc3-519c-40ba-ae13-e3410dd86c82", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-953097537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f4f7b1930e48cb82f5f6010872e221", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277f41f9-00", "ovs_interfaceid": "277f41f9-00ba-4f58-9186-da42879de40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG os_vif [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap277f41f9-00, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:00:02 user nova-compute[82850]: INFO os_vif [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:00:44,bridge_name='br-int',has_traffic_filtering=True,id=277f41f9-00ba-4f58-9186-da42879de40e,network=Network(8d582cc3-519c-40ba-ae13-e3410dd86c82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277f41f9-00')
Apr 12 08:00:02 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Deleting instance files /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104_del
Apr 12 08:00:02 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Deletion of /opt/stack/data/nova/instances/bc267429-544b-4145-b4d9-8c2947c8c104_del complete
Apr 12 08:00:02 user nova-compute[82850]: INFO nova.compute.manager [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 08:00:02 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:00:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:00:03 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Took 0.76 seconds to deallocate network for instance.
Apr 12 08:00:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:00:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:03 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Deleted allocations for instance bc267429-544b-4145-b4d9-8c2947c8c104
Apr 12 08:00:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "bc267429-544b-4145-b4d9-8c2947c8c104" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:04 user nova-compute[82850]: WARNING nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state deleted and task_state None.
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:04 user nova-compute[82850]: WARNING nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state deleted and task_state None.
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Acquiring lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "bc267429-544b-4145-b4d9-8c2947c8c104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] No waiting events found dispatching network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:04 user nova-compute[82850]: WARNING nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received unexpected event network-vif-plugged-277f41f9-00ba-4f58-9186-da42879de40e for instance with vm_state deleted and task_state None.
Apr 12 08:00:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Received event network-vif-deleted-277f41f9-00ba-4f58-9186-da42879de40e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:13 user nova-compute[82850]: INFO nova.compute.manager [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Rescuing
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:13 user nova-compute[82850]: WARNING nova.compute.manager [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state rescuing.
Apr 12 08:00:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance destroyed successfully.
Apr 12 08:00:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Attempting a stable device rescue
Apr 12 08:00:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82850) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance directory exists: not creating {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 08:00:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Creating image(s)
Apr 12 08:00:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'trusted_certs' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "f7fb2ffc338a71f1674a705c28c290696039ee68" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "f7fb2ffc338a71f1674a705c28c290696039ee68" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.part --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG nova.virt.images [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] a2a9667b-9b94-4320-9af3-051b6e3a034d was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.part /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.part /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.converted" returned: 0 in 0.548s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "f7fb2ffc338a71f1674a705c28c290696039ee68" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.486s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "f7fb2ffc338a71f1674a705c28c290696039ee68" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "f7fb2ffc338a71f1674a705c28c290696039ee68" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:16 user nova-compute[82850]: WARNING nova.compute.manager [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state rescuing.
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68 --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68,backing_fmt=raw /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68,backing_fmt=raw /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue" returned: 0 in 0.047s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "f7fb2ffc338a71f1674a705c28c290696039ee68" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'migration_context' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start _get_guest_xml network_info=[{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:c2:53:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a2a9667b-9b94-4320-9af3-051b6e3a034d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '097391de-d8e8-4023-b839-a306aedfb0b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'serial': 'ff4a08c6-c0b2-4ee6-aac1-3000541c8e35'}, 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '5aa7406e-97fa-4ca1-a73f-485cc87f7528', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'numa_topology' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:00:16 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'vcpu_model' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:00:16 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:00:16 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:00:16 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9081249b-ae3a-4485-b3ce-020c9959a88e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uZERbJoM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 08:00:16 user nova-compute[82850]: node.name = iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35
Apr 12 08:00:16 user nova-compute[82850]: node.tpgt = -1
Apr 12 08:00:16 user nova-compute[82850]: node.startup = automatic
Apr 12 08:00:16 user nova-compute[82850]: node.leading_login = No
Apr 12 08:00:16 user nova-compute[82850]: iface.iscsi_ifacename = default
Apr 12 08:00:16 user nova-compute[82850]: iface.net_ifacename = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.ipaddress = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.prefix_len = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.hwaddress = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.transport_name = tcp
Apr 12 08:00:16 user nova-compute[82850]: iface.initiatorname = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.vlan_id = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.vlan_priority = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.vlan_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.iface_num = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.mtu = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.port = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.bootproto = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.subnet_mask = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.gateway = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_alt_client_id = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_dns = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_learn_iqn = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_vendor_id_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_vendor_id = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.dhcp_slp_da = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.fragmentation = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.gratuitous_arp = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.incoming_forwarding = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.tos_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.tos = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.ttl = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.delayed_ack = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.tcp_nagle = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.tcp_wsf_state = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.tcp_wsf = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.tcp_timer_scale = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.tcp_timestamp = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.redirect = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.def_task_mgmt_timeout = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.header_digest = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.data_digest = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.immediate_data = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.initial_r2t = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.data_seq_inorder = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.data_pdu_inorder = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.erl = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.max_receive_data_len = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.first_burst_len = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.max_outstanding_r2t = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.max_burst_len = 0
Apr 12 08:00:16 user nova-compute[82850]: iface.chap_auth = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.bidi_chap = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.strict_login_compliance = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.discovery_auth = <empty>
Apr 12 08:00:16 user nova-compute[82850]: iface.discovery_logout = <empty>
Apr 12 08:00:16 user nova-compute[82850]: node.discovery_address = <empty>
Apr 12 08:00:16 user nova-compute[82850]: node.discovery_port = 0
Apr 12 08:00:16 user nova-compute[82850]: node.discovery_type = static
Apr 12 08:00:16 user nova-compute[82850]: node.session.initial_cmdsn = 0
Apr 12 08:00:16 user nova-compute[82850]: node.session.initial_login_retry_max = 8
Apr 12 08:00:16 user nova-compute[82850]: node.session.xmit_thread_priority = -20
Apr 12 08:00:16 user nova-compute[82850]: node.session.cmds_max = 128
Apr 12 08:00:16 user nova-compute[82850]: node.session.queue_depth = 32
Apr 12 08:00:16 user nova-compute[82850]: node.session.nr_sessions = 1
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.authmethod = CHAP
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.username = uZERbJoM
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.password = ***
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.username_in = <empty>
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.password_in = <empty>
Apr 12 08:00:16 user nova-compute[82850]: node.session.auth.chap_algs = MD5
Apr 12 08:00:16 user nova-compute[82850]: node.session.timeo.replacement_timeout = 120
Apr 12 08:00:16 user nova-compute[82850]: node.session.err_timeo.abort_timeout = 15
Apr 12 08:00:16 user nova-compute[82850]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 08:00:16 user nova-compute[82850]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 08:00:16 user nova-compute[82850]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.FastAbort = Yes
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.InitialR2T = No
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.ImmediateData = Yes
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.MaxConnections = 1
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 08:00:16 user nova-compute[82850]: node.session.iscsi.ERL = 0
Apr 12 08:00:16 user nova-compute[82850]: node.session.scan = manual
Apr 12 08:00:16 user nova-compute[82850]: node.session.reopen_max = 0
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].address = 172.16.0.220
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].port = 3260
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].startup = manual
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].tcp.window_size = 524288
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].tcp.type_of_service = 0
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].timeo.logout_timeout = 15
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].timeo.login_timeout = 15
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].timeo.auth_timeout = 45
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.DataDigest = None
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.IFMarker = No
Apr 12 08:00:16 user nova-compute[82850]: node.conn[0].iscsi.OFMarker = No
Apr 12 08:00:16 user nova-compute[82850]: # END RECORD
Apr 12 08:00:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e42334-49f9-443e-b6d4-3fde6570ff45]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c99ca-9158-4e1c-89a2-33dcbe246e4f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZERbJoM {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZERbJoM" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[235262d7-c453-433f-8327-36223f49c295]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZERbJoM'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ad78a-c919-44bc-bb2e-9f14e71d509c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2c709-41e4-4dc3-a323-f606dc7401fd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:00:16 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:00:16 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:00:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:00:16 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:00:16 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:00:16 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HCTL ('35', '0', '0', 0) found on session 45 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53efc578-c206-4576-87a5-6c0d6881e0a1]: (4, ('0 0 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Searching for a device in session 45 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23864383163343866', 'path': '/dev/sdd'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864383163343866', 'path': '/dev/sdd'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-361817046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-361817046',id=37,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:58:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-vazfdg0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:58:39Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=097391de-d8e8-4023-b839-a306aedfb0b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:c2:53:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "vif_mac": "fa:16:3e:c2:53:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'pci_devices' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:00:16 user nova-compute[82850]:   <uuid>097391de-d8e8-4023-b839-a306aedfb0b2</uuid>
Apr 12 08:00:16 user nova-compute[82850]:   <name>instance-00000025</name>
Apr 12 08:00:16 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:00:16 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:00:16 user nova-compute[82850]:   <metadata>
Apr 12 08:00:16 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:00:16 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-361817046</nova:name>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:00:16</nova:creationTime>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:00:16 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:00:16 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:owner>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:user uuid="2c01e1260cfa45f6b9d225592867f240">tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member</nova:user>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:project uuid="db13f97452634fb888d949ed5382b6c4">tempest-ServerBootFromVolumeStableRescueTest-1210893055</nova:project>
Apr 12 08:00:16 user nova-compute[82850]:       </nova:owner>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:00:16 user nova-compute[82850]:       <nova:ports>
Apr 12 08:00:16 user nova-compute[82850]:         <nova:port uuid="73e030f7-fd13-48ad-9868-9eff44bd7719">
Apr 12 08:00:16 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 08:00:16 user nova-compute[82850]:         </nova:port>
Apr 12 08:00:16 user nova-compute[82850]:       </nova:ports>
Apr 12 08:00:16 user nova-compute[82850]:     </nova:instance>
Apr 12 08:00:16 user nova-compute[82850]:   </metadata>
Apr 12 08:00:16 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:00:16 user nova-compute[82850]:     <system>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="serial">097391de-d8e8-4023-b839-a306aedfb0b2</entry>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="uuid">097391de-d8e8-4023-b839-a306aedfb0b2</entry>
Apr 12 08:00:16 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:00:16 user nova-compute[82850]:     </system>
Apr 12 08:00:16 user nova-compute[82850]:   </sysinfo>
Apr 12 08:00:16 user nova-compute[82850]:   <os>
Apr 12 08:00:16 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:00:16 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:00:16 user nova-compute[82850]:   </os>
Apr 12 08:00:16 user nova-compute[82850]:   <features>
Apr 12 08:00:16 user nova-compute[82850]:     <acpi/>
Apr 12 08:00:16 user nova-compute[82850]:     <apic/>
Apr 12 08:00:16 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:00:16 user nova-compute[82850]:   </features>
Apr 12 08:00:16 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:00:16 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:00:16 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:00:16 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:00:16 user nova-compute[82850]:   </clock>
Apr 12 08:00:16 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:00:16 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:00:16 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:00:16 user nova-compute[82850]:   </cpu>
Apr 12 08:00:16 user nova-compute[82850]:   <devices>
Apr 12 08:00:16 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 08:00:16 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:00:16 user nova-compute[82850]:       <source dev="/dev/sdd"/>
Apr 12 08:00:16 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:00:16 user nova-compute[82850]:       <serial>ff4a08c6-c0b2-4ee6-aac1-3000541c8e35</serial>
Apr 12 08:00:16 user nova-compute[82850]:     </disk>
Apr 12 08:00:16 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:00:16 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:00:16 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue"/>
Apr 12 08:00:16 user nova-compute[82850]:       <target dev="vdb" bus="virtio"/>
Apr 12 08:00:16 user nova-compute[82850]:       <boot order="1"/>
Apr 12 08:00:16 user nova-compute[82850]:     </disk>
Apr 12 08:00:16 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:00:16 user nova-compute[82850]:       <mac address="fa:16:3e:c2:53:64"/>
Apr 12 08:00:16 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:00:16 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:00:16 user nova-compute[82850]:       <target dev="tap73e030f7-fd"/>
Apr 12 08:00:16 user nova-compute[82850]:     </interface>
Apr 12 08:00:16 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:00:16 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/console.log" append="off"/>
Apr 12 08:00:16 user nova-compute[82850]:     </serial>
Apr 12 08:00:16 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:00:16 user nova-compute[82850]:     <video>
Apr 12 08:00:16 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:00:16 user nova-compute[82850]:     </video>
Apr 12 08:00:16 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:00:16 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:00:16 user nova-compute[82850]:     </rng>
Apr 12 08:00:16 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:00:16 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:00:16 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:00:16 user nova-compute[82850]:     </memballoon>
Apr 12 08:00:16 user nova-compute[82850]:   </devices>
Apr 12 08:00:16 user nova-compute[82850]: </domain>
Apr 12 08:00:16 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:00:16 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance destroyed successfully.
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:00:16 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] No VIF found with MAC fa:16:3e:c2:53:64, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:00:17 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286402.4688187, bc267429-544b-4145-b4d9-8c2947c8c104 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:00:17 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] VM Stopped (Lifecycle Event)
Apr 12 08:00:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-82a993cf-9f82-446b-8c9e-0fde8838efd9 None None] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:00:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:18 user nova-compute[82850]: WARNING nova.compute.manager [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state rescuing.
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 097391de-d8e8-4023-b839-a306aedfb0b2 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286420.1626687, 097391de-d8e8-4023-b839-a306aedfb0b2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:00:20 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Resumed (Lifecycle Event)
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:00:20 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286420.1664143, 097391de-d8e8-4023-b839-a306aedfb0b2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:00:20 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Started (Lifecycle Event)
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:00:20 user nova-compute[82850]: WARNING nova.compute.manager [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state rescuing.
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:00:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:00:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:00:28 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:00:29 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:00:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:00:31 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8280MB free_disk=26.010540008544922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:00:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:00:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [{"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-4dcaf13a-b6cd-4a95-92ec-febb027915d3" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:00:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:00:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:00:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:13 user nova-compute[82850]: INFO nova.compute.manager [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Get console output
Apr 12 08:01:13 user nova-compute[82850]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 08:01:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:01:18 user nova-compute[82850]: INFO nova.compute.claims [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Claim successful on node user
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:01:18 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:01:18 user nova-compute[82850]: INFO nova.virt.block_device [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Booting with volume 2f2932d3-d52a-469c-aa79-0d22cd0d5e76 at /dev/vda
Apr 12 08:01:18 user nova-compute[82850]: DEBUG nova.policy [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG os_brick.utils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2829565-dfa0-49c7-9980-d377752bb4e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ef346-9d97-4426-a1f5-c7ee12faab7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa61143-9b12-4d2f-b260-102aff5a5df3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946e690-8060-4c2c-8780-76262b5769b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:01:19 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:01:19 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855d7a5-6897-4042-9e09-072f33c32871]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG os_brick.utils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:01:19 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating existing volume attachment record: c5268516-5dcf-46f4-9f89-1e1fe4ce6aa9 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Successfully created port: 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Successfully updated port: 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG nova.compute.manager [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing instance network info cache due to event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:01:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance network_info: |[{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated VIF entry in instance network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG nova.network.neutron [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:01:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:01:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:01:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Creating image(s)
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Ensure instance console log exists: /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start _get_guest_xml network_info=[{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3b8aaf8-08b9-43e1-bb54-145e57ba5593', 'attached_at': '', 'detached_at': '', 'volume_id': '2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'serial': '2f2932d3-d52a-469c-aa79-0d22cd0d5e76'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'c5268516-5dcf-46f4-9f89-1e1fe4ce6aa9', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:01:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:01:23 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:01:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:01:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:01:23 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135a09c-b5f9-4e58-be6a-d350728d5cea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:01:23 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[144eda7e-9b43-4869-b0b9-008684945886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76] added
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa09596-abe8-413d-9acc-fadfc36698f1]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82524957-ccac-4332-8ee3-c362ecd27d29]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSULIKsH {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSULIKsH" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c26939-fed5-4cac-92f1-f4b9ca683691]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cSULIKsH'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98483346-1450-4201-9bad-c70b9091b914]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b3259-b1c9-4f84-898f-e56b05a92985]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d9cfb-e07e-4042-b1fa-8e05e3ce0581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]
Apr 12 08:01:23 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f8d0c1-b26d-40a6-91f8-b9d43ca01a19]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[97692430-e2ec-465a-8d46-1d9c01871df6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:01:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa4283-1de1-471c-81dd-85a9914046b1]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:01:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23534323338623733', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534323338623733', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuOD0rpfP4PuUuMOKQ886jPUA8umFYO3482wsn3saWm5WKkTYtyvd+nkSzVXl+KmgM9bHfb/6SatPAH9nmFuVos+mspQRjRxiwLhpZq+bO889TxjK74mrxGmUAeaT1p8Q==',key_name='tempest-TestShelveInstance-1002003019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:01:19Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'pci_devices' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:01:24 user nova-compute[82850]:   <uuid>f3b8aaf8-08b9-43e1-bb54-145e57ba5593</uuid>
Apr 12 08:01:24 user nova-compute[82850]:   <name>instance-00000026</name>
Apr 12 08:01:24 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:01:24 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:01:24 user nova-compute[82850]:   <metadata>
Apr 12 08:01:24 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:01:24 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:01:24 user nova-compute[82850]:       <nova:name>tempest-TestShelveInstance-server-926015954</nova:name>
Apr 12 08:01:24 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:01:23</nova:creationTime>
Apr 12 08:01:24 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:01:24 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:01:24 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:01:24 user nova-compute[82850]:       <nova:owner>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:user uuid="e22b66482dae4ed6bfc51cab82b4fd7d">tempest-TestShelveInstance-86825625-project-member</nova:user>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:project uuid="099602ab0d4d4b61ab2482765efc5ae3">tempest-TestShelveInstance-86825625</nova:project>
Apr 12 08:01:24 user nova-compute[82850]:       </nova:owner>
Apr 12 08:01:24 user nova-compute[82850]:       <nova:ports>
Apr 12 08:01:24 user nova-compute[82850]:         <nova:port uuid="358b6856-7e4e-4c61-979a-fffa9cfe27a9">
Apr 12 08:01:24 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 08:01:24 user nova-compute[82850]:         </nova:port>
Apr 12 08:01:24 user nova-compute[82850]:       </nova:ports>
Apr 12 08:01:24 user nova-compute[82850]:     </nova:instance>
Apr 12 08:01:24 user nova-compute[82850]:   </metadata>
Apr 12 08:01:24 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:01:24 user nova-compute[82850]:     <system>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="serial">f3b8aaf8-08b9-43e1-bb54-145e57ba5593</entry>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="uuid">f3b8aaf8-08b9-43e1-bb54-145e57ba5593</entry>
Apr 12 08:01:24 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:01:24 user nova-compute[82850]:     </system>
Apr 12 08:01:24 user nova-compute[82850]:   </sysinfo>
Apr 12 08:01:24 user nova-compute[82850]:   <os>
Apr 12 08:01:24 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:01:24 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:01:24 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:01:24 user nova-compute[82850]:   </os>
Apr 12 08:01:24 user nova-compute[82850]:   <features>
Apr 12 08:01:24 user nova-compute[82850]:     <acpi/>
Apr 12 08:01:24 user nova-compute[82850]:     <apic/>
Apr 12 08:01:24 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:01:24 user nova-compute[82850]:   </features>
Apr 12 08:01:24 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:01:24 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:01:24 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:01:24 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:01:24 user nova-compute[82850]:   </clock>
Apr 12 08:01:24 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:01:24 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:01:24 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:01:24 user nova-compute[82850]:   </cpu>
Apr 12 08:01:24 user nova-compute[82850]:   <devices>
Apr 12 08:01:24 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 08:01:24 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:01:24 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 08:01:24 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:01:24 user nova-compute[82850]:       <serial>2f2932d3-d52a-469c-aa79-0d22cd0d5e76</serial>
Apr 12 08:01:24 user nova-compute[82850]:     </disk>
Apr 12 08:01:24 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:01:24 user nova-compute[82850]:       <mac address="fa:16:3e:f5:b5:37"/>
Apr 12 08:01:24 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:01:24 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:01:24 user nova-compute[82850]:       <target dev="tap358b6856-7e"/>
Apr 12 08:01:24 user nova-compute[82850]:     </interface>
Apr 12 08:01:24 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:01:24 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/console.log" append="off"/>
Apr 12 08:01:24 user nova-compute[82850]:     </serial>
Apr 12 08:01:24 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:01:24 user nova-compute[82850]:     <video>
Apr 12 08:01:24 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:01:24 user nova-compute[82850]:     </video>
Apr 12 08:01:24 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:01:24 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:01:24 user nova-compute[82850]:     </rng>
Apr 12 08:01:24 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:01:24 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:01:24 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:01:24 user nova-compute[82850]:     </memballoon>
Apr 12 08:01:24 user nova-compute[82850]:   </devices>
Apr 12 08:01:24 user nova-compute[82850]: </domain>
Apr 12 08:01:24 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuOD0rpfP4PuUuMOKQ886jPUA8umFYO3482wsn3saWm5WKkTYtyvd+nkSzVXl+KmgM9bHfb/6SatPAH9nmFuVos+mspQRjRxiwLhpZq+bO889TxjK74mrxGmUAeaT1p8Q==',key_name='tempest-TestShelveInstance-1002003019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:01:19Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG os_vif [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap358b6856-7e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap358b6856-7e, col_values=(('external_ids', {'iface-id': '358b6856-7e4e-4c61-979a-fffa9cfe27a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b5:37', 'vm-uuid': 'f3b8aaf8-08b9-43e1-bb54-145e57ba5593'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:01:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:24 user nova-compute[82850]: INFO os_vif [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e')
Apr 12 08:01:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:01:25 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] No VIF found with MAC fa:16:3e:f5:b5:37, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:01:26 user nova-compute[82850]: WARNING nova.compute.manager [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state building and task_state spawning.
Apr 12 08:01:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286488.5914903, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Resumed (Lifecycle Event)
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance spawned successfully.
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286488.596999, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Started (Lifecycle Event)
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:01:28 user nova-compute[82850]: WARNING nova.compute.manager [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state building and task_state spawning.
Apr 12 08:01:28 user nova-compute[82850]: INFO nova.compute.manager [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Took 10.51 seconds to build instance.
Apr 12 08:01:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.618s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:01:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:30 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:01:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:01:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:01:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=26.03752899169922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance a2485039-dabb-4fd6-85a3-2053001139e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:01:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:01:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Updating instance_info_cache with network_info: [{"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-c2da4832-f77d-4e42-85f0-8e370c69f7b8" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:01:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:01:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:03 user nova-compute[82850]: INFO nova.compute.manager [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Unrescuing
Apr 12 08:02:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:02:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquired lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:02:03 user nova-compute[82850]: DEBUG nova.network.neutron [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [{"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Releasing lock "refresh_cache-097391de-d8e8-4023-b839-a306aedfb0b2" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'flavor' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:04 user nova-compute[82850]: WARNING nova.compute.manager [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state rescued and task_state unrescuing.
Apr 12 08:02:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance destroyed successfully.
Apr 12 08:02:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:06 user nova-compute[82850]: WARNING nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state rescued and task_state unrescuing.
Apr 12 08:02:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:06 user nova-compute[82850]: WARNING nova.compute.manager [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state rescued and task_state unrescuing.
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.host [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Removed pending event for 097391de-d8e8-4023-b839-a306aedfb0b2 due to event {{(pid=82850) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286528.5323763, 097391de-d8e8-4023-b839-a306aedfb0b2 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:02:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Resumed (Lifecycle Event)
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:02:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286528.5337431, 097391de-d8e8-4023-b839-a306aedfb0b2 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:02:08 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Started (Lifecycle Event)
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:08 user nova-compute[82850]: WARNING nova.compute.manager [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state None.
Apr 12 08:02:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:14 user nova-compute[82850]: INFO nova.compute.manager [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Terminating instance
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-unplugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Instance destroyed successfully.
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid a2485039-dabb-4fd6-85a3-2053001139e4 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-453121416',display_name='tempest-ServerActionsTestJSON-server-453121416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-453121416',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-lqi5m9bh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=a2485039-dabb-4fd6-85a3-2053001139e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "address": "fa:16:3e:32:4d:25", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeac49a6-c1", "ovs_interfaceid": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_vif [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeac49a6-c1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:02:14 user nova-compute[82850]: INFO os_vif [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4d:25,bridge_name='br-int',has_traffic_filtering=True,id=eeac49a6-c1b5-4fcd-9fae-4caa4f651618,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeac49a6-c1')
Apr 12 08:02:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzeoqvOP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:02:14 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520961b-00c3-40e3-a6e8-54f46100e952]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:02:14 user nova-compute[82850]: No targets found.
Apr 12 08:02:14 user nova-compute[82850]: iSNS:
Apr 12 08:02:14 user nova-compute[82850]: No targets found.
Apr 12 08:02:14 user nova-compute[82850]: STATIC:
Apr 12 08:02:14 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76
Apr 12 08:02:14 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:02:14 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:02:14 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35
Apr 12 08:02:14 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:02:14 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:02:14 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 08:02:14 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:02:14 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:02:14 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b
Apr 12 08:02:14 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:02:14 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:02:14 user nova-compute[82850]: FIRMWARE:
Apr 12 08:02:14 user nova-compute[82850]: No targets found.
Apr 12 08:02:14 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:02:14 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:02:14 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[25110f02-bd89-4434-8b2d-276a4ff8b0e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43db7c-4e24-46b0-995d-5db410074701]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:02:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0ae8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b'): ({'sdc'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Removing single pathed devices sdc {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db3938-830e-4ddd-986e-6885a7097c79]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1d13f-75f7-45ff-9086-40bcd4b60bd4]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flushing IO for device /dev/sdc {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec727d71-48af-4924-896c-f14cc64741e8]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0f1224-c51e-46cf-95cb-59671f9b8eda]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] SCSI volumes sdc have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23361306335356462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_983d2ea8', '/dev/disk/by-id/scsi-1SCST_BIO983d2ea8-3a0c55dbcda11bea') {{(pid=93535) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 08:02:15 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23361306335356462
Apr 12 08:02:15 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_983d2ea8
Apr 12 08:02:15 user nova-compute[82850]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO983d2ea8-3a0c55dbcda11bea
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff0de6-fcd3-4f4c-ac80-dba28f788faa]: (4, None) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0677f41a-ac3a-4bbe-ae18-31c870b9c8ae]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4994a0-3594-4a98-8612-17979e5f7ae4]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260]
Apr 12 08:02:15 user nova-compute[82850]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b, portal: 172.16.0.220,3260] successful.
Apr 12 08:02:15 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0211892-4d87-4d0d-98ee-515eb41bc65b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3e8a6-6a61-465c-869a-8fba8da46b6d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] <== disconnect_volume: return (349ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:02:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Deleting instance files /opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4_del
Apr 12 08:02:15 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Deletion of /opt/stack/data/nova/instances/a2485039-dabb-4fd6-85a3-2053001139e4_del complete
Apr 12 08:02:15 user nova-compute[82850]: INFO nova.compute.manager [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 08:02:15 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:02:15 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:02:16 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Took 0.88 seconds to deallocate network for instance.
Apr 12 08:02:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-deleted-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Acquiring lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Lock "a2485039-dabb-4fd6-85a3-2053001139e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] No waiting events found dispatching network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:02:16 user nova-compute[82850]: WARNING nova.compute.manager [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Received unexpected event network-vif-plugged-eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance with vm_state active and task_state deleting.
Apr 12 08:02:17 user nova-compute[82850]: INFO nova.compute.manager [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Took 0.82 seconds to detach 1 volumes for instance.
Apr 12 08:02:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Deleting volume: e0211892-4d87-4d0d-98ee-515eb41bc65b {{(pid=82850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 08:02:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:17 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:02:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:02:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:17 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Deleted allocations for instance a2485039-dabb-4fd6-85a3-2053001139e4
Apr 12 08:02:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "a2485039-dabb-4fd6-85a3-2053001139e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:29 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286534.8402386, a2485039-dabb-4fd6-85a3-2053001139e4 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:02:29 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] VM Stopped (Lifecycle Event)
Apr 12 08:02:29 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2b40cd5d-c3ab-4709-834c-611274343561 None None] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:02:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:02:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:02:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:02:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:02:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8284MB free_disk=26.028263092041016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:02:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:02:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:02:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:02:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:04 user nova-compute[82850]: INFO nova.compute.manager [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Terminating instance
Apr 12 08:03:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-unplugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] No waiting events found dispatching network-vif-unplugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-unplugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:03:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Instance destroyed successfully.
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'resources' on Instance uuid 4dcaf13a-b6cd-4a95-92ec-febb027915d3 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2014431968',display_name='tempest-ServerActionsTestJSON-server-2014431968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2014431968',id=30,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw==',key_name='tempest-keypair-562229555',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0323c8eafc4012883daccef045d4a5',ramdisk_id='',reservation_id='r-gerbsjo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-836808185',owner_user_name='tempest-ServerActionsTestJSON-836808185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:53:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c21b45cf78564f5092726eaeac38675e',uuid=4dcaf13a-b6cd-4a95-92ec-febb027915d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converting VIF {"id": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "address": "fa:16:3e:06:b7:4d", "network": {"id": "af815a31-5dc3-45af-a83e-9a4374f8315f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1967243571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0323c8eafc4012883daccef045d4a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf3e827-17", "ovs_interfaceid": "2bf3e827-1777-48cf-a8fc-0eeff964afe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG os_vif [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bf3e827-17, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:03:05 user nova-compute[82850]: INFO os_vif [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b7:4d,bridge_name='br-int',has_traffic_filtering=True,id=2bf3e827-1777-48cf-a8fc-0eeff964afe7,network=Network(af815a31-5dc3-45af-a83e-9a4374f8315f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf3e827-17')
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Deleting instance files /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3_del
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Deletion of /opt/stack/data/nova/instances/4dcaf13a-b6cd-4a95-92ec-febb027915d3_del complete
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.compute.manager [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 08:03:05 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Took 0.47 seconds to deallocate network for instance.
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.compute.manager [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-deleted-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:05 user nova-compute[82850]: INFO nova.compute.manager [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Neutron deleted interface 2bf3e827-1777-48cf-a8fc-0eeff964afe7; detaching it from the instance and deleting it from the info cache
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.network.neutron [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.compute.manager [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Detach interface failed, port_id=2bf3e827-1777-48cf-a8fc-0eeff964afe7, reason: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:03:05 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:06 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Deleted allocations for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3
Apr 12 08:03:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.563s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Acquiring lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Lock "4dcaf13a-b6cd-4a95-92ec-febb027915d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:06 user nova-compute[82850]: DEBUG nova.compute.manager [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] No waiting events found dispatching network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:06 user nova-compute[82850]: WARNING nova.compute.manager [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Received unexpected event network-vif-plugged-2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance with vm_state deleted and task_state None.
Apr 12 08:03:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG nova.compute.manager [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing instance network info cache due to event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG nova.network.neutron [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:09 user nova-compute[82850]: INFO nova.compute.manager [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Shelve offloading
Apr 12 08:03:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG nova.network.neutron [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated VIF entry in instance network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG nova.network.neutron [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:03:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance destroyed successfully.
Apr 12 08:03:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:03:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:11 user nova-compute[82850]: WARNING nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state active and task_state shelving.
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:11 user nova-compute[82850]: WARNING nova.compute.manager [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state active and task_state shelving.
Apr 12 08:03:11 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance destroyed successfully.
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'resources' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuOD0rpfP4PuUuMOKQ886jPUA8umFYO3482wsn3saWm5WKkTYtyvd+nkSzVXl+KmgM9bHfb/6SatPAH9nmFuVos+mspQRjRxiwLhpZq+bO889TxjK74mrxGmUAeaT1p8Q==',key_name='tempest-TestShelveInstance-1002003019',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:01:29Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_vif [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap358b6856-7e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:03:11 user nova-compute[82850]: INFO os_vif [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e')
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:03:11 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.compute.manager [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing instance network info cache due to event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG nova.network.neutron [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee5d3b-7092-495a-bc99-348137fd956f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:03:11 user nova-compute[82850]: No targets found.
Apr 12 08:03:11 user nova-compute[82850]: iSNS:
Apr 12 08:03:11 user nova-compute[82850]: No targets found.
Apr 12 08:03:11 user nova-compute[82850]: STATIC:
Apr 12 08:03:11 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76
Apr 12 08:03:11 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:03:11 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:03:11 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35
Apr 12 08:03:11 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:03:11 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:03:11 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 08:03:11 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:03:11 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:03:11 user nova-compute[82850]: FIRMWARE:
Apr 12 08:03:11 user nova-compute[82850]: No targets found.
Apr 12 08:03:11 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:03:11 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:03:11 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc4bb0-3df0-46b4-9644-face818120c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0f4297-78b4-4b4d-8532-c94465791801]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:03:11 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f19441d88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a82a97-4781-4ca5-9e20-e4599a4589ea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab5bed-761d-4349-817d-f6dc7f75b588]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf45b0-3d80-404d-80db-a84c7b034496]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f675e86-118e-482c-8247-cc4b53d95e8f]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:03:11 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49062807-7fd4-4eb8-893c-2b36cafa32ad]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f28f4-bcfe-4afd-b6dd-3dcca2f71af3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]
Apr 12 08:03:12 user nova-compute[82850]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.
Apr 12 08:03:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a916b-1f44-4b93-83be-4448aaaf4691]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== disconnect_volume: return (316ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:03:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deleting instance files /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593_del
Apr 12 08:03:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deletion of /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593_del complete
Apr 12 08:03:12 user nova-compute[82850]: DEBUG nova.network.neutron [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated VIF entry in instance network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG nova.network.neutron [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": null, "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap358b6856-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:03:13 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Deleted allocations for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593
Apr 12 08:03:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'numa_topology' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.546s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:20 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286585.1384428, 4dcaf13a-b6cd-4a95-92ec-febb027915d3 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:03:20 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] VM Stopped (Lifecycle Event)
Apr 12 08:03:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-688f699c-3600-48b0-b158-9406100cdb9a None None] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:03:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:25 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286590.6758592, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:03:25 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Stopped (Lifecycle Event)
Apr 12 08:03:25 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e99e28a6-e9e7-4fad-9809-2c34cbe6c3aa None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:03:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:03:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:03:33 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=26.046890258789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 097391de-d8e8-4023-b839-a306aedfb0b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:03:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:03:34 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:03:34 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:03:34 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:03:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [{"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-6c911478-0ca8-4d4c-9875-2497b6307a6d" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:03:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:03:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:54 user nova-compute[82850]: INFO nova.compute.manager [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Terminating instance
Apr 12 08:03:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-unplugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:03:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Instance destroyed successfully.
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.objects.instance [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-361817046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-361817046',id=37,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-vazfdg0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:02:09Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=097391de-d8e8-4023-b839-a306aedfb0b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "73e030f7-fd13-48ad-9868-9eff44bd7719", "address": "fa:16:3e:c2:53:64", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73e030f7-fd", "ovs_interfaceid": "73e030f7-fd13-48ad-9868-9eff44bd7719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_vif [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73e030f7-fd, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:03:55 user nova-compute[82850]: INFO os_vif [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:53:64,bridge_name='br-int',has_traffic_filtering=True,id=73e030f7-fd13-48ad-9868-9eff44bd7719,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73e030f7-fd')
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZERbJoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:03:55 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb2ed16-3859-4f03-93e0-36bbfe6be76c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:03:55 user nova-compute[82850]: No targets found.
Apr 12 08:03:55 user nova-compute[82850]: iSNS:
Apr 12 08:03:55 user nova-compute[82850]: No targets found.
Apr 12 08:03:55 user nova-compute[82850]: STATIC:
Apr 12 08:03:55 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35
Apr 12 08:03:55 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:03:55 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:03:55 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 08:03:55 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:03:55 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:03:55 user nova-compute[82850]: FIRMWARE:
Apr 12 08:03:55 user nova-compute[82850]: No targets found.
Apr 12 08:03:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:03:55 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:03:55 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2ccece-2e6c-434b-92eb-5200002841b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826b926-ca34-4629-84d0-695cd9a6ccce]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:03:55 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:03:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:03:55 user nova-compute[82850]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 (non-flash)
Apr 12 08:03:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951e49480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35'): ({'sdd'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Removing single pathed devices sdd {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4c461-c5df-4747-b553-5d2038cd1284]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb9ae0-10e6-45d2-bfb6-75898e38dbe9]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flushing IO for device /dev/sdd {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89a2ea-a763-47f9-87a4-9ba354561b5f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed558b5-21bf-42cb-bc41-d54cc737beab]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] SCSI volumes sdd have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab60cf4e-0799-4398-95b8-5d52bd038f4d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b514fd6-d46a-4cae-940b-70266a787a31]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260]
Apr 12 08:03:55 user nova-compute[82850]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35, portal: 172.16.0.220,3260] successful.
Apr 12 08:03:55 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4a08c6-c0b2-4ee6-aac1-3000541c8e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a94cf36-6177-498c-834f-f6872ac5cd80]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== disconnect_volume: return (313ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:03:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Deleting instance files /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2_del
Apr 12 08:03:55 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Deletion of /opt/stack/data/nova/instances/097391de-d8e8-4023-b839-a306aedfb0b2_del complete
Apr 12 08:03:55 user nova-compute[82850]: INFO nova.compute.manager [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 08:03:55 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:03:55 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:03:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:03:56 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-deleted-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:56 user nova-compute[82850]: INFO nova.compute.manager [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Neutron deleted interface 73e030f7-fd13-48ad-9868-9eff44bd7719; detaching it from the instance and deleting it from the info cache
Apr 12 08:03:56 user nova-compute[82850]: DEBUG nova.network.neutron [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:03:56 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Took 0.53 seconds to deallocate network for instance.
Apr 12 08:03:56 user nova-compute[82850]: DEBUG nova.compute.manager [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Detach interface failed, port_id=73e030f7-fd13-48ad-9868-9eff44bd7719, reason: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Acquiring lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Lock "097391de-d8e8-4023-b839-a306aedfb0b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] No waiting events found dispatching network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:03:57 user nova-compute[82850]: WARNING nova.compute.manager [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Received unexpected event network-vif-plugged-73e030f7-fd13-48ad-9868-9eff44bd7719 for instance with vm_state active and task_state deleting.
Apr 12 08:03:57 user nova-compute[82850]: INFO nova.compute.manager [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Took 0.90 seconds to detach 1 volumes for instance.
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:03:57 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Deleted allocations for instance 097391de-d8e8-4023-b839-a306aedfb0b2
Apr 12 08:03:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "097391de-d8e8-4023-b839-a306aedfb0b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.966s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:10 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286635.4606924, 097391de-d8e8-4023-b839-a306aedfb0b2 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:04:10 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] VM Stopped (Lifecycle Event)
Apr 12 08:04:10 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2ded1f31-8e8c-40b0-a492-04ef4b043c39 None None] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:04:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:04:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:04:17 user nova-compute[82850]: INFO nova.compute.claims [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Claim successful on node user
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:04:17 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:04:17 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.policy [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '118e1780ab5f4949b02fc04fe3530036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c02b1f26d0c4f03bde41b79557371a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:04:18 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Creating image(s)
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "/opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "/opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk 1073741824" returned: 0 in 0.050s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.149s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Successfully created port: 1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Cannot resize image /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.objects.instance [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lazy-loading 'migration_context' on Instance uuid f4326088-d99b-4c3d-bfdf-0ef665f14ec1 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Ensure instance console log exists: /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Successfully updated port: 1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquired lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-changed-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG nova.compute.manager [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Refreshing instance network info cache due to event network-changed-1003723d-937c-4399-82af-7ec80698e1c1. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:04:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Acquiring lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Updating instance_info_cache with network_info: [{"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Releasing lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Instance network_info: |[{"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Acquired lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Refreshing network info cache for port 1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Start _get_guest_xml network_info=[{"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:04:20 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:04:20 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1556449323',display_name='tempest-VolumesActionsTest-instance-1556449323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1556449323',id=39,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c02b1f26d0c4f03bde41b79557371a1',ramdisk_id='',reservation_id='r-fzm2q7z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1691614225',owner_user_name='tempest-VolumesActionsTest-1691614225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:04:18Z,user_data=None,user_id='118e1780ab5f4949b02fc04fe3530036',uuid=f4326088-d99b-4c3d-bfdf-0ef665f14ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converting VIF {"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.objects.instance [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lazy-loading 'pci_devices' on Instance uuid f4326088-d99b-4c3d-bfdf-0ef665f14ec1 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:04:20 user nova-compute[82850]:   <uuid>f4326088-d99b-4c3d-bfdf-0ef665f14ec1</uuid>
Apr 12 08:04:20 user nova-compute[82850]:   <name>instance-00000027</name>
Apr 12 08:04:20 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:04:20 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:04:20 user nova-compute[82850]:   <metadata>
Apr 12 08:04:20 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:04:20 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:name>tempest-VolumesActionsTest-instance-1556449323</nova:name>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:04:20</nova:creationTime>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:04:20 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:04:20 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:owner>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:user uuid="118e1780ab5f4949b02fc04fe3530036">tempest-VolumesActionsTest-1691614225-project-member</nova:user>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:project uuid="1c02b1f26d0c4f03bde41b79557371a1">tempest-VolumesActionsTest-1691614225</nova:project>
Apr 12 08:04:20 user nova-compute[82850]:       </nova:owner>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:04:20 user nova-compute[82850]:       <nova:ports>
Apr 12 08:04:20 user nova-compute[82850]:         <nova:port uuid="1003723d-937c-4399-82af-7ec80698e1c1">
Apr 12 08:04:20 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 08:04:20 user nova-compute[82850]:         </nova:port>
Apr 12 08:04:20 user nova-compute[82850]:       </nova:ports>
Apr 12 08:04:20 user nova-compute[82850]:     </nova:instance>
Apr 12 08:04:20 user nova-compute[82850]:   </metadata>
Apr 12 08:04:20 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:04:20 user nova-compute[82850]:     <system>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="serial">f4326088-d99b-4c3d-bfdf-0ef665f14ec1</entry>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="uuid">f4326088-d99b-4c3d-bfdf-0ef665f14ec1</entry>
Apr 12 08:04:20 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:04:20 user nova-compute[82850]:     </system>
Apr 12 08:04:20 user nova-compute[82850]:   </sysinfo>
Apr 12 08:04:20 user nova-compute[82850]:   <os>
Apr 12 08:04:20 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:04:20 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:04:20 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:04:20 user nova-compute[82850]:   </os>
Apr 12 08:04:20 user nova-compute[82850]:   <features>
Apr 12 08:04:20 user nova-compute[82850]:     <acpi/>
Apr 12 08:04:20 user nova-compute[82850]:     <apic/>
Apr 12 08:04:20 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:04:20 user nova-compute[82850]:   </features>
Apr 12 08:04:20 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:04:20 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:04:20 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:04:20 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:04:20 user nova-compute[82850]:   </clock>
Apr 12 08:04:20 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:04:20 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:04:20 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:04:20 user nova-compute[82850]:   </cpu>
Apr 12 08:04:20 user nova-compute[82850]:   <devices>
Apr 12 08:04:20 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:04:20 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:04:20 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk"/>
Apr 12 08:04:20 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:04:20 user nova-compute[82850]:     </disk>
Apr 12 08:04:20 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:04:20 user nova-compute[82850]:       <mac address="fa:16:3e:79:3d:c5"/>
Apr 12 08:04:20 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:04:20 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:04:20 user nova-compute[82850]:       <target dev="tap1003723d-93"/>
Apr 12 08:04:20 user nova-compute[82850]:     </interface>
Apr 12 08:04:20 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:04:20 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/console.log" append="off"/>
Apr 12 08:04:20 user nova-compute[82850]:     </serial>
Apr 12 08:04:20 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:04:20 user nova-compute[82850]:     <video>
Apr 12 08:04:20 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:04:20 user nova-compute[82850]:     </video>
Apr 12 08:04:20 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:04:20 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:04:20 user nova-compute[82850]:     </rng>
Apr 12 08:04:20 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:04:20 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:04:20 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:04:20 user nova-compute[82850]:     </memballoon>
Apr 12 08:04:20 user nova-compute[82850]:   </devices>
Apr 12 08:04:20 user nova-compute[82850]: </domain>
Apr 12 08:04:20 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1556449323',display_name='tempest-VolumesActionsTest-instance-1556449323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1556449323',id=39,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c02b1f26d0c4f03bde41b79557371a1',ramdisk_id='',reservation_id='r-fzm2q7z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1691614225',owner_user_name='tempest-VolumesActionsTest-1691614225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:04:18Z,user_data=None,user_id='118e1780ab5f4949b02fc04fe3530036',uuid=f4326088-d99b-4c3d-bfdf-0ef665f14ec1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converting VIF {"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG os_vif [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1003723d-93, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1003723d-93, col_values=(('external_ids', {'iface-id': '1003723d-937c-4399-82af-7ec80698e1c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:3d:c5', 'vm-uuid': 'f4326088-d99b-4c3d-bfdf-0ef665f14ec1'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:20 user nova-compute[82850]: INFO os_vif [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93')
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] No VIF found with MAC fa:16:3e:79:3d:c5, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Updated VIF entry in instance network info cache for port 1003723d-937c-4399-82af-7ec80698e1c1. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG nova.network.neutron [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Updating instance_info_cache with network_info: [{"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:04:20 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Releasing lock "refresh_cache-f4326088-d99b-4c3d-bfdf-0ef665f14ec1" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:21 user nova-compute[82850]: DEBUG nova.compute.manager [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] No waiting events found dispatching network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:04:21 user nova-compute[82850]: WARNING nova.compute.manager [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received unexpected event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 for instance with vm_state building and task_state spawning.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286663.6864822, f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] VM Resumed (Lifecycle Event)
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Instance spawned successfully.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286663.686914, f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] VM Started (Lifecycle Event)
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] No waiting events found dispatching network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:04:23 user nova-compute[82850]: WARNING nova.compute.manager [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received unexpected event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 for instance with vm_state building and task_state spawning.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:04:23 user nova-compute[82850]: INFO nova.compute.manager [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Took 6.33 seconds to build instance.
Apr 12 08:04:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:33 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:04:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:35 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:04:35 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=26.03598403930664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:04:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:04:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [{"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-4f136818-14e2-4d2e-81db-cb32a3ecd497" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:04:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:45 user nova-compute[82850]: INFO nova.compute.manager [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Terminating instance
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-unplugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] No waiting events found dispatching network-vif-unplugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-unplugged-1609868b-1b37-4997-81c6-d1390f862b7e for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:04:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Instance destroyed successfully.
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid c2da4832-f77d-4e42-85f0-8e370c69f7b8 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-167399412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-167399412',id=34,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-v1j4hda1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:57:20Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=c2da4832-f77d-4e42-85f0-8e370c69f7b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "1609868b-1b37-4997-81c6-d1390f862b7e", "address": "fa:16:3e:72:f0:b0", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1609868b-1b", "ovs_interfaceid": "1609868b-1b37-4997-81c6-d1390f862b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG os_vif [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1609868b-1b, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:45 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:04:45 user nova-compute[82850]: INFO os_vif [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=1609868b-1b37-4997-81c6-d1390f862b7e,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1609868b-1b')
Apr 12 08:04:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Deleting instance files /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8_del
Apr 12 08:04:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Deletion of /opt/stack/data/nova/instances/c2da4832-f77d-4e42-85f0-8e370c69f7b8_del complete
Apr 12 08:04:46 user nova-compute[82850]: INFO nova.compute.manager [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 08:04:46 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:04:46 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Took 0.56 seconds to deallocate network for instance.
Apr 12 08:04:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:04:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:46 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Deleted allocations for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8
Apr 12 08:04:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.625s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Acquiring lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:04:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:04:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Lock "c2da4832-f77d-4e42-85f0-8e370c69f7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:04:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] No waiting events found dispatching network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:04:47 user nova-compute[82850]: WARNING nova.compute.manager [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received unexpected event network-vif-plugged-1609868b-1b37-4997-81c6-d1390f862b7e for instance with vm_state deleted and task_state None.
Apr 12 08:04:47 user nova-compute[82850]: DEBUG nova.compute.manager [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Received event network-vif-deleted-1609868b-1b37-4997-81c6-d1390f862b7e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:04:50 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:04:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286685.9351037, c2da4832-f77d-4e42-85f0-8e370c69f7b8 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:05:00 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] VM Stopped (Lifecycle Event)
Apr 12 08:05:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-33f369a7-55e9-4205-bfc0-6257b85fee42 None None] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:05:00 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:01 user nova-compute[82850]: INFO nova.compute.manager [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Unshelving
Apr 12 08:05:01 user nova-compute[82850]: INFO nova.virt.block_device [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Booting with volume 2f2932d3-d52a-469c-aa79-0d22cd0d5e76 at /dev/vda
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.utils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52ea40b-89bc-4159-b264-60b211be094d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ffee0-e2eb-488a-b251-4360a1f25127]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3a666-7b8c-400c-b151-ddb8a2e22c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0779b2-35bc-4612-ab7e-021cd6519025]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:05:01 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:05:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77802cd3-5341-4191-b972-1b98b96ea201]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG os_brick.utils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:05:01 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating existing volume attachment record: 3dd93222-894a-44ad-9c64-82be40a4dfa0 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:05:05 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'pci_requests' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'numa_topology' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:05:06 user nova-compute[82850]: INFO nova.compute.claims [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Claim successful on node user
Apr 12 08:05:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:06 user nova-compute[82850]: INFO nova.network.neutron [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 08:05:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.compute.manager [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing instance network info cache due to event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:05:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Creating image(s)
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Did not create local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Ensure instance console log exists: /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start _get_guest_xml network_info=[{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3b8aaf8-08b9-43e1-bb54-145e57ba5593', 'attached_at': '', 'detached_at': '', 'volume_id': '2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'serial': '2f2932d3-d52a-469c-aa79-0d22cd0d5e76'}, 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '3dd93222-894a-44ad-9c64-82be40a4dfa0', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.network.neutron [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:05:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:05:07 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:05:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:05:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:05:07 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba8fdb-c132-4147-8fe7-80cf5e37f7ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:05:07 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e773804-a32d-4d19-8afe-9f658ad3c752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76] added
Apr 12 08:05:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca65f1a-0e40-4dd8-b3c5-042c9d4daa2a]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc4e4f-3e49-4872-b0d9-64252065c248]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSULIKsH {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSULIKsH" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[974dff97-5a00-413b-8d4e-6211bd062a14]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cSULIKsH'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6abe3ad-7f4d-4c66-8efa-762cc7882b5c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea17f3-d4d1-4753-92f6-16fc2b9358d5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964f2ed-ec57-4519-a944-9148a172615a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]
Apr 12 08:05:07 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.
Apr 12 08:05:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdea3d2-fc91-46ef-9298-1766ee16e683]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a176063-46c6-4b69-86fe-e5a696c69001]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:08 user nova-compute[82850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:05:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:08 user nova-compute[82850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:05:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ba134-7533-453e-b160-c1dba188f747]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated VIF entry in instance network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:05:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23534323338623733', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534323338623733', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1002003019',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:05:01Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.objects.instance [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'pci_devices' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:05:09 user nova-compute[82850]:   <uuid>f3b8aaf8-08b9-43e1-bb54-145e57ba5593</uuid>
Apr 12 08:05:09 user nova-compute[82850]:   <name>instance-00000026</name>
Apr 12 08:05:09 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:05:09 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:05:09 user nova-compute[82850]:   <metadata>
Apr 12 08:05:09 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:05:09 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:05:09 user nova-compute[82850]:       <nova:name>tempest-TestShelveInstance-server-926015954</nova:name>
Apr 12 08:05:09 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:05:07</nova:creationTime>
Apr 12 08:05:09 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:05:09 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:05:09 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:05:09 user nova-compute[82850]:       <nova:owner>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:user uuid="e22b66482dae4ed6bfc51cab82b4fd7d">tempest-TestShelveInstance-86825625-project-member</nova:user>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:project uuid="099602ab0d4d4b61ab2482765efc5ae3">tempest-TestShelveInstance-86825625</nova:project>
Apr 12 08:05:09 user nova-compute[82850]:       </nova:owner>
Apr 12 08:05:09 user nova-compute[82850]:       <nova:ports>
Apr 12 08:05:09 user nova-compute[82850]:         <nova:port uuid="358b6856-7e4e-4c61-979a-fffa9cfe27a9">
Apr 12 08:05:09 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 08:05:09 user nova-compute[82850]:         </nova:port>
Apr 12 08:05:09 user nova-compute[82850]:       </nova:ports>
Apr 12 08:05:09 user nova-compute[82850]:     </nova:instance>
Apr 12 08:05:09 user nova-compute[82850]:   </metadata>
Apr 12 08:05:09 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:05:09 user nova-compute[82850]:     <system>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="serial">f3b8aaf8-08b9-43e1-bb54-145e57ba5593</entry>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="uuid">f3b8aaf8-08b9-43e1-bb54-145e57ba5593</entry>
Apr 12 08:05:09 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:05:09 user nova-compute[82850]:     </system>
Apr 12 08:05:09 user nova-compute[82850]:   </sysinfo>
Apr 12 08:05:09 user nova-compute[82850]:   <os>
Apr 12 08:05:09 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:05:09 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:05:09 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:05:09 user nova-compute[82850]:   </os>
Apr 12 08:05:09 user nova-compute[82850]:   <features>
Apr 12 08:05:09 user nova-compute[82850]:     <acpi/>
Apr 12 08:05:09 user nova-compute[82850]:     <apic/>
Apr 12 08:05:09 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:05:09 user nova-compute[82850]:   </features>
Apr 12 08:05:09 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:05:09 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:05:09 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:05:09 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:05:09 user nova-compute[82850]:   </clock>
Apr 12 08:05:09 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:05:09 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:05:09 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:05:09 user nova-compute[82850]:   </cpu>
Apr 12 08:05:09 user nova-compute[82850]:   <devices>
Apr 12 08:05:09 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 08:05:09 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:05:09 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 08:05:09 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:05:09 user nova-compute[82850]:       <serial>2f2932d3-d52a-469c-aa79-0d22cd0d5e76</serial>
Apr 12 08:05:09 user nova-compute[82850]:     </disk>
Apr 12 08:05:09 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:05:09 user nova-compute[82850]:       <mac address="fa:16:3e:f5:b5:37"/>
Apr 12 08:05:09 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:05:09 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:05:09 user nova-compute[82850]:       <target dev="tap358b6856-7e"/>
Apr 12 08:05:09 user nova-compute[82850]:     </interface>
Apr 12 08:05:09 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:05:09 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/console.log" append="off"/>
Apr 12 08:05:09 user nova-compute[82850]:     </serial>
Apr 12 08:05:09 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:05:09 user nova-compute[82850]:     <video>
Apr 12 08:05:09 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:05:09 user nova-compute[82850]:     </video>
Apr 12 08:05:09 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:05:09 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:05:09 user nova-compute[82850]:     </rng>
Apr 12 08:05:09 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:05:09 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:05:09 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:05:09 user nova-compute[82850]:     </memballoon>
Apr 12 08:05:09 user nova-compute[82850]:   </devices>
Apr 12 08:05:09 user nova-compute[82850]: </domain>
Apr 12 08:05:09 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1002003019',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:05:01Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG os_vif [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap358b6856-7e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap358b6856-7e, col_values=(('external_ids', {'iface-id': '358b6856-7e4e-4c61-979a-fffa9cfe27a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b5:37', 'vm-uuid': 'f3b8aaf8-08b9-43e1-bb54-145e57ba5593'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:09 user nova-compute[82850]: INFO os_vif [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e')
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:05:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] No VIF found with MAC fa:16:3e:f5:b5:37, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:05:10 user nova-compute[82850]: WARNING nova.compute.manager [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 08:05:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286712.507074, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:05:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Resumed (Lifecycle Event)
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:05:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance spawned successfully.
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:05:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286712.5109735, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:05:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Started (Lifecycle Event)
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.222s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:05:12 user nova-compute[82850]: WARNING nova.compute.manager [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state active and task_state None.
Apr 12 08:05:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:23 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:23 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:05:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:05:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:35 user nova-compute[82850]: INFO nova.compute.manager [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Terminating instance
Apr 12 08:05:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:05:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.compute.manager [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-unplugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:05:36 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Instance destroyed successfully.
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.objects.instance [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-216955781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-216955781',id=27,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-g149p1ws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:53:37Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=4f136818-14e2-4d2e-81db-cb32a3ecd497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "8eee7860-e187-49d6-8595-784114b9fb4f", "address": "fa:16:3e:21:4a:a9", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee7860-e1", "ovs_interfaceid": "8eee7860-e187-49d6-8595-784114b9fb4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:05:36 user nova-compute[82850]: DEBUG os_vif [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eee7860-e1, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:37 user nova-compute[82850]: INFO os_vif [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:a9,bridge_name='br-int',has_traffic_filtering=True,id=8eee7860-e187-49d6-8595-784114b9fb4f,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eee7860-e1')
Apr 12 08:05:37 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:05:37 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=26.10748291015625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQXWwIeR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:05:37 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da32994-81b4-4b94-ba5a-96bbab649ce2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:05:37 user nova-compute[82850]: No targets found.
Apr 12 08:05:37 user nova-compute[82850]: iSNS:
Apr 12 08:05:37 user nova-compute[82850]: No targets found.
Apr 12 08:05:37 user nova-compute[82850]: STATIC:
Apr 12 08:05:37 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76
Apr 12 08:05:37 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:05:37 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:05:37 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30
Apr 12 08:05:37 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:05:37 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:05:37 user nova-compute[82850]: FIRMWARE:
Apr 12 08:05:37 user nova-compute[82850]: No targets found.
Apr 12 08:05:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:05:37 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:05:37 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98eb1e-9784-4d65-832b-5d7404c5fe52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b315413c-ca08-4d4a-9871-eb99b91cc613]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:37 user nova-compute[82850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:05:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 (non-flash)
Apr 12 08:05:37 user nova-compute[82850]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:05:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1944372050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30'): ({'sde'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Removing single pathed devices sde {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6b8fe5-1dfe-42cf-b8bf-da8e46843060]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b47b46-8ff5-422d-9f67-773ec5203b96]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flushing IO for device /dev/sde {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef1d77-63c6-4d40-971b-4e05182f7feb]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff272b67-4569-48ac-b73e-da471d05dfde]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] SCSI volumes sde have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea0e58d-77e8-4af3-95e8-c4eb9f7870ac]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a06defb-782c-41d8-af93-eebfd1cc6ab1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260]
Apr 12 08:05:37 user nova-compute[82850]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30, portal: 172.16.0.220,3260] successful.
Apr 12 08:05:37 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9813c06-7a70-4358-8070-a77e87f88b30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe6c6c4-e932-4c9d-8652-31bcd83e2a04]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] <== disconnect_volume: return (288ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:05:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Deleting instance files /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497_del
Apr 12 08:05:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Deletion of /opt/stack/data/nova/instances/4f136818-14e2-4d2e-81db-cb32a3ecd497_del complete
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:05:37 user nova-compute[82850]: INFO nova.compute.manager [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Took 1.50 seconds to destroy the instance on the hypervisor.
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:05:37 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Took 0.51 seconds to deallocate network for instance.
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-deleted-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:37 user nova-compute[82850]: INFO nova.compute.manager [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Neutron deleted interface 8eee7860-e187-49d6-8595-784114b9fb4f; detaching it from the instance and deleting it from the info cache
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.network.neutron [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:05:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Detach interface failed, port_id=8eee7860-e187-49d6-8595-784114b9fb4f, reason: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Acquiring lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] No waiting events found dispatching network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:05:38 user nova-compute[82850]: WARNING nova.compute.manager [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Received unexpected event network-vif-plugged-8eee7860-e187-49d6-8595-784114b9fb4f for instance with vm_state active and task_state deleting.
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:05:38 user nova-compute[82850]: INFO nova.compute.manager [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:05:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:39 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Deleted allocations for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497
Apr 12 08:05:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "4f136818-14e2-4d2e-81db-cb32a3ecd497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:05:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:05:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:51 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286736.655005, 4f136818-14e2-4d2e-81db-cb32a3ecd497 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:05:51 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] VM Stopped (Lifecycle Event)
Apr 12 08:05:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-438ad81f-7c02-4842-9efd-53ceda73e58f None None] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:05:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:05:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:05:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:06:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:12 user nova-compute[82850]: INFO nova.compute.manager [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Terminating instance
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-unplugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] No waiting events found dispatching network-vif-unplugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-unplugged-1003723d-937c-4399-82af-7ec80698e1c1 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Instance destroyed successfully.
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.objects.instance [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lazy-loading 'resources' on Instance uuid f4326088-d99b-4c3d-bfdf-0ef665f14ec1 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1556449323',display_name='tempest-VolumesActionsTest-instance-1556449323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1556449323',id=39,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c02b1f26d0c4f03bde41b79557371a1',ramdisk_id='',reservation_id='r-fzm2q7z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1691614225',owner_user_name='tempest-VolumesActionsTest-1691614225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:04:24Z,user_data=None,user_id='118e1780ab5f4949b02fc04fe3530036',uuid=f4326088-d99b-4c3d-bfdf-0ef665f14ec1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converting VIF {"id": "1003723d-937c-4399-82af-7ec80698e1c1", "address": "fa:16:3e:79:3d:c5", "network": {"id": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-425157507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1c02b1f26d0c4f03bde41b79557371a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003723d-93", "ovs_interfaceid": "1003723d-937c-4399-82af-7ec80698e1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG os_vif [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1003723d-93, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:12 user nova-compute[82850]: INFO os_vif [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3d:c5,bridge_name='br-int',has_traffic_filtering=True,id=1003723d-937c-4399-82af-7ec80698e1c1,network=Network(344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003723d-93')
Apr 12 08:06:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Deleting instance files /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1_del
Apr 12 08:06:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Deletion of /opt/stack/data/nova/instances/f4326088-d99b-4c3d-bfdf-0ef665f14ec1_del complete
Apr 12 08:06:12 user nova-compute[82850]: INFO nova.compute.manager [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 08:06:12 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:06:12 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:13 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Took 0.43 seconds to deallocate network for instance.
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-deleted-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:13 user nova-compute[82850]: INFO nova.compute.manager [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Neutron deleted interface 1003723d-937c-4399-82af-7ec80698e1c1; detaching it from the instance and deleting it from the info cache
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.network.neutron [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Detach interface failed, port_id=1003723d-937c-4399-82af-7ec80698e1c1, reason: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:13 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Deleted allocations for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:13 user nova-compute[82850]: WARNING nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid f4326088-d99b-4c3d-bfdf-0ef665f14ec1 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.427s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.030s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Acquiring lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Lock "f4326088-d99b-4c3d-bfdf-0ef665f14ec1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] No waiting events found dispatching network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:14 user nova-compute[82850]: WARNING nova.compute.manager [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Received unexpected event network-vif-plugged-1003723d-937c-4399-82af-7ec80698e1c1 for instance with vm_state deleted and task_state None.
Apr 12 08:06:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:06:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:26 user nova-compute[82850]: INFO nova.compute.manager [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Terminating instance
Apr 12 08:06:26 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-unplugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] No waiting events found dispatching network-vif-unplugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:26 user nova-compute[82850]: DEBUG nova.compute.manager [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-unplugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Instance destroyed successfully.
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'resources' on Instance uuid 6c911478-0ca8-4d4c-9875-2497b6307a6d {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-341409038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-341409038',id=20,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:46:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db13f97452634fb888d949ed5382b6c4',ramdisk_id='',reservation_id='r-ejp6htxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:48:48Z,user_data=None,user_id='2c01e1260cfa45f6b9d225592867f240',uuid=6c911478-0ca8-4d4c-9875-2497b6307a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converting VIF {"id": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "address": "fa:16:3e:25:90:04", "network": {"id": "b8a83b38-0d35-47f7-9c68-5c0606d94c19", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1095529146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db13f97452634fb888d949ed5382b6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f429c2-3e", "ovs_interfaceid": "28f429c2-3e75-45e6-b544-e3dfc70c9a67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG os_vif [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28f429c2-3e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:27 user nova-compute[82850]: INFO os_vif [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:90:04,bridge_name='br-int',has_traffic_filtering=True,id=28f429c2-3e75-45e6-b544-e3dfc70c9a67,network=Network(b8a83b38-0d35-47f7-9c68-5c0606d94c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f429c2-3e')
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Deleting instance files /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d_del
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Deletion of /opt/stack/data/nova/instances/6c911478-0ca8-4d4c-9875-2497b6307a6d_del complete
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.compute.manager [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 08:06:27 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Took 0.44 seconds to deallocate network for instance.
Apr 12 08:06:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-deleted-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286772.8941464, f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] VM Stopped (Lifecycle Event)
Apr 12 08:06:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-dd7e4216-855c-44ae-9d38-361e8c39ff04 None None] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:06:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:27 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Deleted allocations for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d
Apr 12 08:06:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.456s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Acquiring lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Lock "6c911478-0ca8-4d4c-9875-2497b6307a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] No waiting events found dispatching network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:28 user nova-compute[82850]: WARNING nova.compute.manager [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Received unexpected event network-vif-plugged-28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance with vm_state deleted and task_state None.
Apr 12 08:06:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:32 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:33 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:33 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:06:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:06:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:06:38 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=26.216224670410156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:06:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:06:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:06:40 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:42 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286787.1531212, 6c911478-0ca8-4d4c-9875-2497b6307a6d => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:06:42 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] VM Stopped (Lifecycle Event)
Apr 12 08:06:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-700358fb-472c-4eb4-bb39-10fb5cc159a7 None None] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:06:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:06:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing instance network info cache due to event network-changed-358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Acquiring lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Acquired lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Refreshing network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:52 user nova-compute[82850]: INFO nova.compute.manager [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Terminating instance
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.compute.manager [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-unplugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updated VIF entry in instance network info cache for port 358b6856-7e4e-4c61-979a-fffa9cfe27a9. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [{"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Releasing lock "refresh_cache-f3b8aaf8-08b9-43e1-bb54-145e57ba5593" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:06:52 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Instance destroyed successfully.
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'resources' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-926015954',display_name='tempest-TestShelveInstance-server-926015954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-926015954',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuOD0rpfP4PuUuMOKQ886jPUA8umFYO3482wsn3saWm5WKkTYtyvd+nkSzVXl+KmgM9bHfb/6SatPAH9nmFuVos+mspQRjRxiwLhpZq+bO889TxjK74mrxGmUAeaT1p8Q==',key_name='tempest-TestShelveInstance-1002003019',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='099602ab0d4d4b61ab2482765efc5ae3',ramdisk_id='',reservation_id='r-md35qomo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-86825625',owner_user_name='tempest-TestShelveInstance-86825625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:05:13Z,user_data=None,user_id='e22b66482dae4ed6bfc51cab82b4fd7d',uuid=f3b8aaf8-08b9-43e1-bb54-145e57ba5593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converting VIF {"id": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "address": "fa:16:3e:f5:b5:37", "network": {"id": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1025018238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "099602ab0d4d4b61ab2482765efc5ae3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358b6856-7e", "ovs_interfaceid": "358b6856-7e4e-4c61-979a-fffa9cfe27a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_vif [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap358b6856-7e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:06:52 user nova-compute[82850]: INFO os_vif [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b5:37,bridge_name='br-int',has_traffic_filtering=True,id=358b6856-7e4e-4c61-979a-fffa9cfe27a9,network=Network(bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358b6856-7e')
Apr 12 08:06:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSULIKsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:06:52 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebfa91-be66-450a-b738-9f3fbbe2710d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:06:52 user nova-compute[82850]: No targets found.
Apr 12 08:06:52 user nova-compute[82850]: iSNS:
Apr 12 08:06:52 user nova-compute[82850]: No targets found.
Apr 12 08:06:52 user nova-compute[82850]: STATIC:
Apr 12 08:06:52 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76
Apr 12 08:06:52 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:06:52 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:06:52 user nova-compute[82850]: FIRMWARE:
Apr 12 08:06:52 user nova-compute[82850]: No targets found.
Apr 12 08:06:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:06:52 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:06:52 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb0704-1a27-48c9-afe2-9325a5e90a70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b990487-9385-4435-8318-981d1eae3656]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:06:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 (non-flash)
Apr 12 08:06:52 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f19342cd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed154b-7cf4-429a-904a-123fe25fb76a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43053d95-dd7b-467a-ac4f-a799173a7418]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[413aaffa-9520-4180-ad70-54d3f20fd15e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf8681-3b76-4f58-a160-5e19ec0fd4e0]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7e673-0798-4e3c-9052-41d574f2185b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a2edd9-6dd6-4d25-9e3c-0a21d242b192]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260]
Apr 12 08:06:53 user nova-compute[82850]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76, portal: 172.16.0.220,3260] successful.
Apr 12 08:06:53 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2932d3-d52a-469c-aa79-0d22cd0d5e76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b307d3-4eb1-43f0-8edc-50c7179cff86]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] <== disconnect_volume: return (317ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:06:53 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deleting instance files /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593_del
Apr 12 08:06:53 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deletion of /opt/stack/data/nova/instances/f3b8aaf8-08b9-43e1-bb54-145e57ba5593_del complete
Apr 12 08:06:53 user nova-compute[82850]: INFO nova.compute.manager [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 12 08:06:53 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:06:53 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:06:53 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Took 0.46 seconds to deallocate network for instance.
Apr 12 08:06:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-deleted-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Acquiring lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG nova.compute.manager [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] No waiting events found dispatching network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:06:54 user nova-compute[82850]: WARNING nova.compute.manager [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Received unexpected event network-vif-plugged-358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance with vm_state active and task_state deleting.
Apr 12 08:06:54 user nova-compute[82850]: INFO nova.compute.manager [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Took 0.81 seconds to detach 1 volumes for instance.
Apr 12 08:06:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Deleting volume: 2f2932d3-d52a-469c-aa79-0d22cd0d5e76 {{(pid=82850) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:54 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Deleted allocations for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593
Apr 12 08:06:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "f3b8aaf8-08b9-43e1-bb54-145e57ba5593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.840s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:06:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:06:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286812.8335507, f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:07:07 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] VM Stopped (Lifecycle Event)
Apr 12 08:07:07 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5cdd8be0-a369-47bf-8046-25c17e993674 None None] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:07:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:07:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:07:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:07:31 user nova-compute[82850]: INFO nova.compute.claims [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Claim successful on node user
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:07:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.policy [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:07:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Creating image(s)
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:31 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk 1073741824" returned: 0 in 0.048s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Successfully created port: c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Cannot resize image /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'migration_context' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Ensure instance console log exists: /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Successfully updated port: c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG nova.compute.manager [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing instance network info cache due to event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:07:33 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance network_info: |[{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.neutron [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start _get_guest_xml network_info=[{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:07:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:07:34 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGUsZk+0FFRlxN7ot18soKqADFCkS7i/wDGGcWd/SeiRgvm3dHu7GHBm8NFwvIgAzAthDChntTADY+w7rAzzxwPIbXCJPKJLjzBnPTlb5heDyZwU3YMzanBVuqyf5fx2A==',key_name='tempest-keypair-1482956523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_devices' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:07:34 user nova-compute[82850]:   <uuid>16df9bdc-e946-4d1b-be3c-d460123b0fa5</uuid>
Apr 12 08:07:34 user nova-compute[82850]:   <name>instance-00000028</name>
Apr 12 08:07:34 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:07:34 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:07:34 user nova-compute[82850]:   <metadata>
Apr 12 08:07:34 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:07:34 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1715890719</nova:name>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:07:34</nova:creationTime>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:07:34 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:07:34 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:owner>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:user uuid="705c265380f543848a986352fa2e385c">tempest-AttachVolumeShelveTestJSON-1176597283-project-member</nova:user>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:project uuid="0eca5169ebeb49208b99a1aba27b8f2d">tempest-AttachVolumeShelveTestJSON-1176597283</nova:project>
Apr 12 08:07:34 user nova-compute[82850]:       </nova:owner>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:07:34 user nova-compute[82850]:       <nova:ports>
Apr 12 08:07:34 user nova-compute[82850]:         <nova:port uuid="c52a7d72-ce8f-4795-ae56-6b9ec9366f0a">
Apr 12 08:07:34 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 08:07:34 user nova-compute[82850]:         </nova:port>
Apr 12 08:07:34 user nova-compute[82850]:       </nova:ports>
Apr 12 08:07:34 user nova-compute[82850]:     </nova:instance>
Apr 12 08:07:34 user nova-compute[82850]:   </metadata>
Apr 12 08:07:34 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:07:34 user nova-compute[82850]:     <system>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="serial">16df9bdc-e946-4d1b-be3c-d460123b0fa5</entry>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="uuid">16df9bdc-e946-4d1b-be3c-d460123b0fa5</entry>
Apr 12 08:07:34 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:07:34 user nova-compute[82850]:     </system>
Apr 12 08:07:34 user nova-compute[82850]:   </sysinfo>
Apr 12 08:07:34 user nova-compute[82850]:   <os>
Apr 12 08:07:34 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:07:34 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:07:34 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:07:34 user nova-compute[82850]:   </os>
Apr 12 08:07:34 user nova-compute[82850]:   <features>
Apr 12 08:07:34 user nova-compute[82850]:     <acpi/>
Apr 12 08:07:34 user nova-compute[82850]:     <apic/>
Apr 12 08:07:34 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:07:34 user nova-compute[82850]:   </features>
Apr 12 08:07:34 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:07:34 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:07:34 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:07:34 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:07:34 user nova-compute[82850]:   </clock>
Apr 12 08:07:34 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:07:34 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:07:34 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:07:34 user nova-compute[82850]:   </cpu>
Apr 12 08:07:34 user nova-compute[82850]:   <devices>
Apr 12 08:07:34 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:07:34 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:07:34 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk"/>
Apr 12 08:07:34 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:07:34 user nova-compute[82850]:     </disk>
Apr 12 08:07:34 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:07:34 user nova-compute[82850]:       <mac address="fa:16:3e:c5:24:ac"/>
Apr 12 08:07:34 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:07:34 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:07:34 user nova-compute[82850]:       <target dev="tapc52a7d72-ce"/>
Apr 12 08:07:34 user nova-compute[82850]:     </interface>
Apr 12 08:07:34 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:07:34 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/console.log" append="off"/>
Apr 12 08:07:34 user nova-compute[82850]:     </serial>
Apr 12 08:07:34 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:07:34 user nova-compute[82850]:     <video>
Apr 12 08:07:34 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:07:34 user nova-compute[82850]:     </video>
Apr 12 08:07:34 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:07:34 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:07:34 user nova-compute[82850]:     </rng>
Apr 12 08:07:34 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:07:34 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:07:34 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:07:34 user nova-compute[82850]:     </memballoon>
Apr 12 08:07:34 user nova-compute[82850]:   </devices>
Apr 12 08:07:34 user nova-compute[82850]: </domain>
Apr 12 08:07:34 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGUsZk+0FFRlxN7ot18soKqADFCkS7i/wDGGcWd/SeiRgvm3dHu7GHBm8NFwvIgAzAthDChntTADY+w7rAzzxwPIbXCJPKJLjzBnPTlb5heDyZwU3YMzanBVuqyf5fx2A==',key_name='tempest-keypair-1482956523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG os_vif [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc52a7d72-ce, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc52a7d72-ce, col_values=(('external_ids', {'iface-id': 'c52a7d72-ce8f-4795-ae56-6b9ec9366f0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:24:ac', 'vm-uuid': '16df9bdc-e946-4d1b-be3c-d460123b0fa5'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:34 user nova-compute[82850]: INFO os_vif [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce')
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No VIF found with MAC fa:16:3e:c5:24:ac, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.neutron [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated VIF entry in instance network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG nova.network.neutron [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:07:34 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:35 user nova-compute[82850]: DEBUG nova.compute.manager [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:07:35 user nova-compute[82850]: WARNING nova.compute.manager [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state building and task_state spawning.
Apr 12 08:07:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286857.7613325, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Resumed (Lifecycle Event)
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance spawned successfully.
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286857.7630641, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Started (Lifecycle Event)
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:37 user nova-compute[82850]: DEBUG nova.compute.manager [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:07:37 user nova-compute[82850]: WARNING nova.compute.manager [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state building and task_state spawning.
Apr 12 08:07:37 user nova-compute[82850]: INFO nova.compute.manager [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Took 6.43 seconds to build instance.
Apr 12 08:07:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.541s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:07:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=26.20374298095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:07:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:07:41 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:07:42 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:07:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:07:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:07:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:07:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:07:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:08:08 user nova-compute[82850]: INFO nova.compute.claims [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Claim successful on node user
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:08:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.policy [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:08:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Creating image(s)
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "/opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "/opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "/opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk 1073741824" returned: 0 in 0.053s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:09 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Successfully created port: 3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Cannot resize image /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'migration_context' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Ensure instance console log exists: /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Successfully updated port: 3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing instance network info cache due to event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:08:10 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Instance network_info: |[{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.neutron [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Start _get_guest_xml network_info=[{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:08:11 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:08:11 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015532211',display_name='tempest-TestStampPattern-server-2015532211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015532211',id=41,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-omjkmy98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:08:09Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=43d46682-0451-46c3-88f7-4dd09d0cd4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'pci_devices' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:08:11 user nova-compute[82850]:   <uuid>43d46682-0451-46c3-88f7-4dd09d0cd4e9</uuid>
Apr 12 08:08:11 user nova-compute[82850]:   <name>instance-00000029</name>
Apr 12 08:08:11 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:08:11 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:08:11 user nova-compute[82850]:   <metadata>
Apr 12 08:08:11 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:08:11 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:name>tempest-TestStampPattern-server-2015532211</nova:name>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:08:11</nova:creationTime>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:08:11 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:08:11 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:owner>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:user uuid="97536e3b50284fbc81a9188166e90a7a">tempest-TestStampPattern-1602124066-project-member</nova:user>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:project uuid="d2abfb00bf93470c9e71aa01f477ccf7">tempest-TestStampPattern-1602124066</nova:project>
Apr 12 08:08:11 user nova-compute[82850]:       </nova:owner>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:08:11 user nova-compute[82850]:       <nova:ports>
Apr 12 08:08:11 user nova-compute[82850]:         <nova:port uuid="3b60e3e3-a92c-40bb-bed4-796cdbd6074e">
Apr 12 08:08:11 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 08:08:11 user nova-compute[82850]:         </nova:port>
Apr 12 08:08:11 user nova-compute[82850]:       </nova:ports>
Apr 12 08:08:11 user nova-compute[82850]:     </nova:instance>
Apr 12 08:08:11 user nova-compute[82850]:   </metadata>
Apr 12 08:08:11 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:08:11 user nova-compute[82850]:     <system>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="serial">43d46682-0451-46c3-88f7-4dd09d0cd4e9</entry>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="uuid">43d46682-0451-46c3-88f7-4dd09d0cd4e9</entry>
Apr 12 08:08:11 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:08:11 user nova-compute[82850]:     </system>
Apr 12 08:08:11 user nova-compute[82850]:   </sysinfo>
Apr 12 08:08:11 user nova-compute[82850]:   <os>
Apr 12 08:08:11 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:08:11 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:08:11 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:08:11 user nova-compute[82850]:   </os>
Apr 12 08:08:11 user nova-compute[82850]:   <features>
Apr 12 08:08:11 user nova-compute[82850]:     <acpi/>
Apr 12 08:08:11 user nova-compute[82850]:     <apic/>
Apr 12 08:08:11 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:08:11 user nova-compute[82850]:   </features>
Apr 12 08:08:11 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:08:11 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:08:11 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:08:11 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:08:11 user nova-compute[82850]:   </clock>
Apr 12 08:08:11 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:08:11 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:08:11 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:08:11 user nova-compute[82850]:   </cpu>
Apr 12 08:08:11 user nova-compute[82850]:   <devices>
Apr 12 08:08:11 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:08:11 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:08:11 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk"/>
Apr 12 08:08:11 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:08:11 user nova-compute[82850]:     </disk>
Apr 12 08:08:11 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:08:11 user nova-compute[82850]:       <mac address="fa:16:3e:ee:d5:16"/>
Apr 12 08:08:11 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:08:11 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:08:11 user nova-compute[82850]:       <target dev="tap3b60e3e3-a9"/>
Apr 12 08:08:11 user nova-compute[82850]:     </interface>
Apr 12 08:08:11 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:08:11 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/console.log" append="off"/>
Apr 12 08:08:11 user nova-compute[82850]:     </serial>
Apr 12 08:08:11 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:08:11 user nova-compute[82850]:     <video>
Apr 12 08:08:11 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:08:11 user nova-compute[82850]:     </video>
Apr 12 08:08:11 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:08:11 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:08:11 user nova-compute[82850]:     </rng>
Apr 12 08:08:11 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:08:11 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:08:11 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:08:11 user nova-compute[82850]:     </memballoon>
Apr 12 08:08:11 user nova-compute[82850]:   </devices>
Apr 12 08:08:11 user nova-compute[82850]: </domain>
Apr 12 08:08:11 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015532211',display_name='tempest-TestStampPattern-server-2015532211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015532211',id=41,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-omjkmy98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:08:09Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=43d46682-0451-46c3-88f7-4dd09d0cd4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG os_vif [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b60e3e3-a9, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b60e3e3-a9, col_values=(('external_ids', {'iface-id': '3b60e3e3-a92c-40bb-bed4-796cdbd6074e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:d5:16', 'vm-uuid': '43d46682-0451-46c3-88f7-4dd09d0cd4e9'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:11 user nova-compute[82850]: INFO os_vif [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9')
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No VIF found with MAC fa:16:3e:ee:d5:16, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.neutron [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated VIF entry in instance network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG nova.network.neutron [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:08:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] No waiting events found dispatching network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:08:12 user nova-compute[82850]: WARNING nova.compute.manager [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received unexpected event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance with vm_state building and task_state spawning.
Apr 12 08:08:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] No waiting events found dispatching network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:08:14 user nova-compute[82850]: WARNING nova.compute.manager [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received unexpected event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance with vm_state building and task_state spawning.
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286894.650172, 43d46682-0451-46c3-88f7-4dd09d0cd4e9 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] VM Resumed (Lifecycle Event)
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Instance spawned successfully.
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681286894.6613584, 43d46682-0451-46c3-88f7-4dd09d0cd4e9 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] VM Started (Lifecycle Event)
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 12 08:08:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:08:14 user nova-compute[82850]: INFO nova.compute.manager [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Took 5.95 seconds to build instance.
Apr 12 08:08:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.045s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:08:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:08:40 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:08:40 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:08:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=26.16024398803711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:08:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:08:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:08:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:08:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:09:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing instance network info cache due to event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:09:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:09:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:09:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:09:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated VIF entry in instance network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:09:23 user nova-compute[82850]: DEBUG nova.network.neutron [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:09:23 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:09:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:24 user nova-compute[82850]: INFO nova.compute.manager [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Shelving
Apr 12 08:09:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG nova.compute.manager [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:09:25 user nova-compute[82850]: WARNING nova.compute.manager [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state active and task_state shelving.
Apr 12 08:09:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance destroyed successfully.
Apr 12 08:09:25 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Beginning cold snapshot process
Apr 12 08:09:25 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:09:25 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk /opt/stack/data/nova/instances/snapshots/tmpo553ahkq/8172c9058831438492a9c8381ed29b41 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:09:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:26 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk /opt/stack/data/nova/instances/snapshots/tmpo553ahkq/8172c9058831438492a9c8381ed29b41" returned: 0 in 0.251s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:09:26 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Snapshot extracted, beginning image upload
Apr 12 08:09:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:09:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:09:27 user nova-compute[82850]: WARNING nova.compute.manager [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 08:09:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Snapshot image upload complete
Apr 12 08:09:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:09:28 user nova-compute[82850]: INFO nova.compute.manager [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Shelve offloading
Apr 12 08:09:28 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance destroyed successfully.
Apr 12 08:09:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:09:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:09:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:09:28 user nova-compute[82850]: DEBUG nova.network.neutron [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.network.neutron [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:09:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance destroyed successfully.
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.objects.instance [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'resources' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGUsZk+0FFRlxN7ot18soKqADFCkS7i/wDGGcWd/SeiRgvm3dHu7GHBm8NFwvIgAzAthDChntTADY+w7rAzzxwPIbXCJPKJLjzBnPTlb5heDyZwU3YMzanBVuqyf5fx2A==',key_name='tempest-keypair-1482956523',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:09:28.736826',shelved_host='user',shelved_image_id='30c57275-0755-4de8-96e7-141c8e34bbf1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG os_vif [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc52a7d72-ce, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:29 user nova-compute[82850]: INFO os_vif [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce')
Apr 12 08:09:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Deleting instance files /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5_del
Apr 12 08:09:29 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Deletion of /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5_del complete
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing instance network info cache due to event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:09:29 user nova-compute[82850]: DEBUG nova.network.neutron [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:09:29 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Deleted allocations for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5
Apr 12 08:09:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG nova.objects.instance [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'numa_topology' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.296s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated VIF entry in instance network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:09:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:09:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:09:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:09:40 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:09:40 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=26.14300537109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681286965.5193267, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:09:40 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Stopped (Lifecycle Event)
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2beeccda-cf43-42bd-aa7a-0f2eb6fb04b1 None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:09:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:09:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:09:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:09:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:09:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:09:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:09:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:09:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:09:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:09:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing instance network info cache due to event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.network.neutron [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:10:00 user nova-compute[82850]: INFO nova.compute.manager [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Attaching volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 to /dev/vdb
Apr 12 08:10:00 user nova-compute[82850]: DEBUG os_brick.utils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.network.neutron [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated VIF entry in instance network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG nova.network.neutron [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4e892c-05f4-4678-b145-ddbbab336f7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94046534-a3d0-46ae-b1f0-29f38e78c2e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ceaed9-8f37-4538-95cc-249a321b9fc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf868a-7679-45de-85ce-0d184a69bdeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:10:01 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:10:01 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125faf5-a0a0-41ab-a20a-3ed959a7eaf2]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG os_brick.utils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating existing volume attachment record: 56ea2c9f-cb87-4326-960d-f391d4b27b80 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:10:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byFzZEOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:10:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:10:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:10:06 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ad476-d956-45eb-9085-f58b8764370c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:10:06 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47270e-3b08-460e-b909-d0665a0fc5bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3] added
Apr 12 08:10:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6ebaf-281f-4cd4-8b96-bd45cdca6cad]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432acb7-8c4e-4d54-b40f-149898ed7efa]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byFzZEOu {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byFzZEOu" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6693c0-eeb4-43d7-865d-3f9b3fd12562]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byFzZEOu'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5bc9e8-cbc4-4ebb-bdfa-db01e4ef5179]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de787eb-3ad7-45d5-9fac-de964a138c6b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:10:06 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:10:06 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:10:06 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:10:06 user nova-compute[82850]: 
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafe7619-13da-4a83-8f23-b452c332e846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260]
Apr 12 08:10:06 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260] successful.
Apr 12 08:10:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7debb-e7e5-4d19-a9dc-cd7406c26ae5]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fdfa73-e3a0-4df1-91f4-ebc5832400c4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)
Apr 12 08:10:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)
Apr 12 08:10:06 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cab23f-d5f4-4e40-b5d5-1f05271e4713]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:10:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byFzZEOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:10:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:10:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23436306165326334', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:10:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436306165326334', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:10:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:10:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 08:10:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:10:07 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:10:07 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:10:07 user nova-compute[82850]:   <serial>8255ab1c-52c3-4e07-82d7-d73ec99b20f3</serial>
Apr 12 08:10:07 user nova-compute[82850]: </disk>
Apr 12 08:10:07 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 08:10:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:10:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:10:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No VIF found with MAC fa:16:3e:ee:d5:16, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:10:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.423s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:10:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:10:09 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:10:09 user nova-compute[82850]: INFO nova.compute.manager [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Detaching volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3
Apr 12 08:10:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:09 user nova-compute[82850]: INFO nova.virt.block_device [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Attempting to driver detach volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 from mountpoint /dev/vdb
Apr 12 08:10:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Attempting to detach device vdb from instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:10:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:10:09 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:10:09 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:10:09 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:10:09 user nova-compute[82850]:   <serial>8255ab1c-52c3-4e07-82d7-d73ec99b20f3</serial>
Apr 12 08:10:09 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:10:09 user nova-compute[82850]: </disk>
Apr 12 08:10:09 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:10:09 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully detached device vdb from instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 from the persistent domain config.
Apr 12 08:10:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:10:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:10:09 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:10:09 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:10:09 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:10:09 user nova-compute[82850]:   <serial>8255ab1c-52c3-4e07-82d7-d73ec99b20f3</serial>
Apr 12 08:10:09 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:10:09 user nova-compute[82850]: </disk>
Apr 12 08:10:09 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681287010.3706338, 43d46682-0451-46c3-88f7-4dd09d0cd4e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:10:10 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully detached device vdb from instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 from the live domain config.
Apr 12 08:10:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byFzZEOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:10:10 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3ec6f-7e93-416f-a7fa-7e665687e5ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:10:10 user nova-compute[82850]: No targets found.
Apr 12 08:10:10 user nova-compute[82850]: iSNS:
Apr 12 08:10:10 user nova-compute[82850]: No targets found.
Apr 12 08:10:10 user nova-compute[82850]: STATIC:
Apr 12 08:10:10 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3
Apr 12 08:10:10 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:10:10 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:10:10 user nova-compute[82850]: FIRMWARE:
Apr 12 08:10:10 user nova-compute[82850]: No targets found.
Apr 12 08:10:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:10:10 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:10:10 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ce3b4-d293-41f2-be97-696ecac2e918]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[43223a9f-08c5-427e-a11a-fe1622e80fe3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)
Apr 12 08:10:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 (non-flash)
Apr 12 08:10:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c459bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e9211-bc85-4cb2-9373-f75a5caf8dc0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f41c0-c1df-450a-9dbf-2c5adb8e67e0]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36c795-6fb2-44d9-92ae-cf18434070c2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[100fe9a0-6c95-44a2-8bf5-a7e93ec070bc]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96fbd4e-ca32-4721-929f-7a206e3df54b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5610ef-6876-4f72-9c47-60643b942041]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260]
Apr 12 08:10:10 user nova-compute[82850]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3, portal: 172.16.0.220,3260] successful.
Apr 12 08:10:10 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8255ab1c-52c3-4e07-82d7-d73ec99b20f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6403b5c-d941-48df-9467-3fcd32030ca2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== disconnect_volume: return (383ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:10:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:10:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:11 user nova-compute[82850]: DEBUG nova.objects.instance [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:10:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:10:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:36 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:36 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:10:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:10:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:10:38 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:41 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:10:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:10:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=26.14191436767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:10:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:10:43 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:10:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:02 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:03 user nova-compute[82850]: INFO nova.compute.manager [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] instance snapshotting
Apr 12 08:11:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Beginning live snapshot process
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json -f qcow2 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:03 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d.delta 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d.delta 1073741824" returned: 0 in 0.048s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:04 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 08:11:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82850) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 08:11:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 08:11:05 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:11:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d.delta /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d.delta /opt/stack/data/nova/instances/snapshots/tmpyn8ge9v9/2e15d3416ed34edfad2fee46bcfff08d" returned: 0 in 0.253s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:05 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Snapshot extracted, beginning image upload
Apr 12 08:11:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Snapshot image upload complete
Apr 12 08:11:07 user nova-compute[82850]: INFO nova.compute.manager [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Took 4.29 seconds to snapshot the instance on the hypervisor.
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:11:12 user nova-compute[82850]: INFO nova.compute.claims [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Claim successful on node user
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:11:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.policy [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:11:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Creating image(s)
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "/opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "/opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Successfully created port: ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG nova.virt.images [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 5849deaf-c4ba-409a-b228-b19d3ac3cca8 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.part /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.part /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.converted" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.095s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:13 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Successfully updated port: ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d,backing_fmt=raw /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.compute.manager [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing instance network info cache due to event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Acquiring lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Acquired lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing network info cache for port ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d,backing_fmt=raw /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk 1073741824" returned: 0 in 0.106s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d --force-share --output=json" returned: 0 in 0.128s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.objects.instance [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'migration_context' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Ensure instance console log exists: /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Releasing lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquired lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:14 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Releasing lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance network_info: |[{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Start _get_guest_xml network_info=[{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f01b3a644f84b7fafa8ba7a598495dd2',container_format='bare',created_at=2023-04-12T08:11:03Z,direct_url=<?>,disk_format='qcow2',id=5849deaf-c4ba-409a-b228-b19d3ac3cca8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1356949786',owner='d2abfb00bf93470c9e71aa01f477ccf7',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T08:11:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5849deaf-c4ba-409a-b228-b19d3ac3cca8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:11:15 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:15 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f01b3a644f84b7fafa8ba7a598495dd2',container_format='bare',created_at=2023-04-12T08:11:03Z,direct_url=<?>,disk_format='qcow2',id=5849deaf-c4ba-409a-b228-b19d3ac3cca8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1356949786',owner='d2abfb00bf93470c9e71aa01f477ccf7',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T08:11:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086621763',display_name='tempest-TestStampPattern-server-1086621763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086621763',id=42,image_ref='5849deaf-c4ba-409a-b228-b19d3ac3cca8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-co9mz602',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='43d46682-0451-46c3-88f7-4dd09d0cd4e9',image_min_disk='1',image_min_ram='0',image_owner_id='d2abfb00bf93470c9e71aa01f477ccf7',image_owner_project_name='tempest-TestStampPattern-1602124066',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1602124066-project-member',image_user_id='97536e3b50284fbc81a9188166e90a7a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:11:13Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=0c151ba7-5711-44f0-aa2a-10b26dc77474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.objects.instance [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:11:15 user nova-compute[82850]:   <uuid>0c151ba7-5711-44f0-aa2a-10b26dc77474</uuid>
Apr 12 08:11:15 user nova-compute[82850]:   <name>instance-0000002a</name>
Apr 12 08:11:15 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:11:15 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:11:15 user nova-compute[82850]:   <metadata>
Apr 12 08:11:15 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:11:15 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:name>tempest-TestStampPattern-server-1086621763</nova:name>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:11:15</nova:creationTime>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:11:15 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:11:15 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:owner>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:user uuid="97536e3b50284fbc81a9188166e90a7a">tempest-TestStampPattern-1602124066-project-member</nova:user>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:project uuid="d2abfb00bf93470c9e71aa01f477ccf7">tempest-TestStampPattern-1602124066</nova:project>
Apr 12 08:11:15 user nova-compute[82850]:       </nova:owner>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:root type="image" uuid="5849deaf-c4ba-409a-b228-b19d3ac3cca8"/>
Apr 12 08:11:15 user nova-compute[82850]:       <nova:ports>
Apr 12 08:11:15 user nova-compute[82850]:         <nova:port uuid="ee0639fa-801c-48ac-aa70-654e7f04ce3a">
Apr 12 08:11:15 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 08:11:15 user nova-compute[82850]:         </nova:port>
Apr 12 08:11:15 user nova-compute[82850]:       </nova:ports>
Apr 12 08:11:15 user nova-compute[82850]:     </nova:instance>
Apr 12 08:11:15 user nova-compute[82850]:   </metadata>
Apr 12 08:11:15 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:11:15 user nova-compute[82850]:     <system>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="serial">0c151ba7-5711-44f0-aa2a-10b26dc77474</entry>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="uuid">0c151ba7-5711-44f0-aa2a-10b26dc77474</entry>
Apr 12 08:11:15 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:11:15 user nova-compute[82850]:     </system>
Apr 12 08:11:15 user nova-compute[82850]:   </sysinfo>
Apr 12 08:11:15 user nova-compute[82850]:   <os>
Apr 12 08:11:15 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:11:15 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:11:15 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:11:15 user nova-compute[82850]:   </os>
Apr 12 08:11:15 user nova-compute[82850]:   <features>
Apr 12 08:11:15 user nova-compute[82850]:     <acpi/>
Apr 12 08:11:15 user nova-compute[82850]:     <apic/>
Apr 12 08:11:15 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:11:15 user nova-compute[82850]:   </features>
Apr 12 08:11:15 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:11:15 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:11:15 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:11:15 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:11:15 user nova-compute[82850]:   </clock>
Apr 12 08:11:15 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:11:15 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:11:15 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:11:15 user nova-compute[82850]:   </cpu>
Apr 12 08:11:15 user nova-compute[82850]:   <devices>
Apr 12 08:11:15 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:11:15 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:11:15 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk"/>
Apr 12 08:11:15 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:11:15 user nova-compute[82850]:     </disk>
Apr 12 08:11:15 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:11:15 user nova-compute[82850]:       <mac address="fa:16:3e:fd:2d:99"/>
Apr 12 08:11:15 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:11:15 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:11:15 user nova-compute[82850]:       <target dev="tapee0639fa-80"/>
Apr 12 08:11:15 user nova-compute[82850]:     </interface>
Apr 12 08:11:15 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:11:15 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/console.log" append="off"/>
Apr 12 08:11:15 user nova-compute[82850]:     </serial>
Apr 12 08:11:15 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:11:15 user nova-compute[82850]:     <video>
Apr 12 08:11:15 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:11:15 user nova-compute[82850]:     </video>
Apr 12 08:11:15 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:11:15 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:11:15 user nova-compute[82850]:     </rng>
Apr 12 08:11:15 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:11:15 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:11:15 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:11:15 user nova-compute[82850]:     </memballoon>
Apr 12 08:11:15 user nova-compute[82850]:   </devices>
Apr 12 08:11:15 user nova-compute[82850]: </domain>
Apr 12 08:11:15 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086621763',display_name='tempest-TestStampPattern-server-1086621763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086621763',id=42,image_ref='5849deaf-c4ba-409a-b228-b19d3ac3cca8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-co9mz602',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='43d46682-0451-46c3-88f7-4dd09d0cd4e9',image_min_disk='1',image_min_ram='0',image_owner_id='d2abfb00bf93470c9e71aa01f477ccf7',image_owner_project_name='tempest-TestStampPattern-1602124066',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1602124066-project-member',image_user_id='97536e3b50284fbc81a9188166e90a7a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:11:13Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=0c151ba7-5711-44f0-aa2a-10b26dc77474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG os_vif [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0639fa-80, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0639fa-80, col_values=(('external_ids', {'iface-id': 'ee0639fa-801c-48ac-aa70-654e7f04ce3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:2d:99', 'vm-uuid': '0c151ba7-5711-44f0-aa2a-10b26dc77474'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:15 user nova-compute[82850]: INFO os_vif [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80')
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:11:15 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No VIF found with MAC fa:16:3e:fd:2d:99, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG nova.compute.manager [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] No waiting events found dispatching network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:11:16 user nova-compute[82850]: WARNING nova.compute.manager [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received unexpected event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance with vm_state building and task_state spawning.
Apr 12 08:11:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:16 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:16 user nova-compute[82850]: INFO nova.compute.manager [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Unshelving
Apr 12 08:11:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:16 user nova-compute[82850]: INFO nova.virt.block_device [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Booting with volume fcf45fc6-227c-4f48-8bd7-36232092aa61 at /dev/vdc
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.utils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c72b174-526d-4c9a-bacc-cc71f9cfb851]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396ce91-6647-428e-96f7-95cbcc45c94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cef687-b4d1-4324-b8a7-e62ab3800fba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efaa37-b7e3-47f5-a26a-27a871879e1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:11:17 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:11:17 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe6d2f-32fa-447a-b842-f2ba8ef88b7b]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG os_brick.utils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:11:17 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating existing volume attachment record: 6e62e0b8-5cc1-47c4-ab4d-7eefc866fc5f {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287078.856807, 0c151ba7-5711-44f0-aa2a-10b26dc77474 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] VM Resumed (Lifecycle Event)
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance spawned successfully.
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] No waiting events found dispatching network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:11:18 user nova-compute[82850]: WARNING nova.compute.manager [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received unexpected event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance with vm_state building and task_state spawning.
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287078.857325, 0c151ba7-5711-44f0-aa2a-10b26dc77474 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] VM Started (Lifecycle Event)
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 12 08:11:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:18 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:11:19 user nova-compute[82850]: INFO nova.compute.manager [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Took 6.90 seconds to build instance.
Apr 12 08:11:19 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:20 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_requests' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'numa_topology' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:11:21 user nova-compute[82850]: INFO nova.compute.claims [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Claim successful on node user
Apr 12 08:11:21 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:11:21 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:21 user nova-compute[82850]: INFO nova.network.neutron [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.compute.manager [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing instance network info cache due to event network-changed-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.network.neutron [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:11:22 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Creating image(s)
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Refreshing network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG nova.virt.images [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 30c57275-0755-4de8-96e7-141c8e34bbf1 was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.part /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.part /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.converted" returned: 0 in 0.155s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated VIF entry in instance network info cache for port c52a7d72-ce8f-4795-ae56-6b9ec9366f0a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG nova.network.neutron [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.165s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json" returned: 0 in 0.221s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f,backing_fmt=raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f,backing_fmt=raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk 1073741824" returned: 0 in 0.057s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f --force-share --output=json" returned: 0 in 0.183s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'migration_context' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:24 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Rebasing disk image.
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.176s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:24 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 -F raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:25 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 -F raw /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk" returned: 0 in 2.251s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Ensure instance console log exists: /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start _get_guest_xml network_info=[{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8c6bf2ddb42b559a4ebfb11c99eacf59',container_format='bare',created_at=2023-04-12T08:09:25Z,direct_url=<?>,disk_format='qcow2',id=30c57275-0755-4de8-96e7-141c8e34bbf1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1715890719-shelved',owner='0eca5169ebeb49208b99a1aba27b8f2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T08:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MulOkoUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '16df9bdc-e946-4d1b-be3c-d460123b0fa5', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcf45fc6-227c-4f48-8bd7-36232092aa61', 'serial': 'fcf45fc6-227c-4f48-8bd7-36232092aa61'}, 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '6e62e0b8-5cc1-47c4-ab4d-7eefc866fc5f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:11:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:27 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8c6bf2ddb42b559a4ebfb11c99eacf59',container_format='bare',created_at=2023-04-12T08:09:25Z,direct_url=<?>,disk_format='qcow2',id=30c57275-0755-4de8-96e7-141c8e34bbf1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1715890719-shelved',owner='0eca5169ebeb49208b99a1aba27b8f2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T08:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MulOkoUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:11:27 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:11:27 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:11:27 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11e91b-5b49-4379-9a94-b60a3251b3a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:11:27 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[198aa88f-10bc-44f7-a3eb-aa1186bdaa39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61] added
Apr 12 08:11:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba96b6-d343-4146-a78d-5dbfc3a5d892]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498b743-f3c5-4135-9505-0a37aa5446aa]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MulOkoUX {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MulOkoUX" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d22d46-c66e-49e7-a96f-01390c1327da]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MulOkoUX'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07c5c8-59af-4d8a-80b1-7afa977d564b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b3ef6-4167-4691-a499-d5ed5460aeb2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:11:27 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:11:27 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:11:27 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:11:27 user nova-compute[82850]: 
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3e975-49b5-4edc-8d06-225df104cb26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260]
Apr 12 08:11:27 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260] successful.
Apr 12 08:11:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3b273d-8fb4-4d89-8410-65903cbd0e80]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f94b7-91cf-4a46-af04-1b309d00b4fb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)
Apr 12 08:11:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)
Apr 12 08:11:27 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44aca4e-cdb9-4a37-9381-f83a81419fd3]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:11:27 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MulOkoUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23738336333366462', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738336333366462', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='30c57275-0755-4de8-96e7-141c8e34bbf1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1482956523',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:09:28.736826',shelved_host='user',shelved_image_id='30c57275-0755-4de8-96e7-141c8e34bbf1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.objects.instance [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_devices' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:11:28 user nova-compute[82850]:   <uuid>16df9bdc-e946-4d1b-be3c-d460123b0fa5</uuid>
Apr 12 08:11:28 user nova-compute[82850]:   <name>instance-00000028</name>
Apr 12 08:11:28 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:11:28 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:11:28 user nova-compute[82850]:   <metadata>
Apr 12 08:11:28 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:11:28 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1715890719</nova:name>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:11:27</nova:creationTime>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:11:28 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:11:28 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:owner>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:user uuid="705c265380f543848a986352fa2e385c">tempest-AttachVolumeShelveTestJSON-1176597283-project-member</nova:user>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:project uuid="0eca5169ebeb49208b99a1aba27b8f2d">tempest-AttachVolumeShelveTestJSON-1176597283</nova:project>
Apr 12 08:11:28 user nova-compute[82850]:       </nova:owner>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:root type="image" uuid="30c57275-0755-4de8-96e7-141c8e34bbf1"/>
Apr 12 08:11:28 user nova-compute[82850]:       <nova:ports>
Apr 12 08:11:28 user nova-compute[82850]:         <nova:port uuid="c52a7d72-ce8f-4795-ae56-6b9ec9366f0a">
Apr 12 08:11:28 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 08:11:28 user nova-compute[82850]:         </nova:port>
Apr 12 08:11:28 user nova-compute[82850]:       </nova:ports>
Apr 12 08:11:28 user nova-compute[82850]:     </nova:instance>
Apr 12 08:11:28 user nova-compute[82850]:   </metadata>
Apr 12 08:11:28 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:11:28 user nova-compute[82850]:     <system>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="serial">16df9bdc-e946-4d1b-be3c-d460123b0fa5</entry>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="uuid">16df9bdc-e946-4d1b-be3c-d460123b0fa5</entry>
Apr 12 08:11:28 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:11:28 user nova-compute[82850]:     </system>
Apr 12 08:11:28 user nova-compute[82850]:   </sysinfo>
Apr 12 08:11:28 user nova-compute[82850]:   <os>
Apr 12 08:11:28 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:11:28 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:11:28 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:11:28 user nova-compute[82850]:   </os>
Apr 12 08:11:28 user nova-compute[82850]:   <features>
Apr 12 08:11:28 user nova-compute[82850]:     <acpi/>
Apr 12 08:11:28 user nova-compute[82850]:     <apic/>
Apr 12 08:11:28 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:11:28 user nova-compute[82850]:   </features>
Apr 12 08:11:28 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:11:28 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:11:28 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:11:28 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:11:28 user nova-compute[82850]:   </clock>
Apr 12 08:11:28 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:11:28 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:11:28 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:11:28 user nova-compute[82850]:   </cpu>
Apr 12 08:11:28 user nova-compute[82850]:   <devices>
Apr 12 08:11:28 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:11:28 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:11:28 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk"/>
Apr 12 08:11:28 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:11:28 user nova-compute[82850]:     </disk>
Apr 12 08:11:28 user nova-compute[82850]:     <disk type="block" device="disk">
Apr 12 08:11:28 user nova-compute[82850]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:11:28 user nova-compute[82850]:       <source dev="/dev/sdb"/>
Apr 12 08:11:28 user nova-compute[82850]:       <target dev="vdc" bus="virtio"/>
Apr 12 08:11:28 user nova-compute[82850]:       <serial>fcf45fc6-227c-4f48-8bd7-36232092aa61</serial>
Apr 12 08:11:28 user nova-compute[82850]:     </disk>
Apr 12 08:11:28 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:11:28 user nova-compute[82850]:       <mac address="fa:16:3e:c5:24:ac"/>
Apr 12 08:11:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:11:28 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:11:28 user nova-compute[82850]:       <target dev="tapc52a7d72-ce"/>
Apr 12 08:11:28 user nova-compute[82850]:     </interface>
Apr 12 08:11:28 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:11:28 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/console.log" append="off"/>
Apr 12 08:11:28 user nova-compute[82850]:     </serial>
Apr 12 08:11:28 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:11:28 user nova-compute[82850]:     <video>
Apr 12 08:11:28 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:11:28 user nova-compute[82850]:     </video>
Apr 12 08:11:28 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:11:28 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:11:28 user nova-compute[82850]:     </rng>
Apr 12 08:11:28 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:11:28 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:11:28 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:11:28 user nova-compute[82850]:     </memballoon>
Apr 12 08:11:28 user nova-compute[82850]:   </devices>
Apr 12 08:11:28 user nova-compute[82850]: </domain>
Apr 12 08:11:28 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='30c57275-0755-4de8-96e7-141c8e34bbf1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1482956523',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:09:28.736826',shelved_host='user',shelved_image_id='30c57275-0755-4de8-96e7-141c8e34bbf1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG os_vif [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc52a7d72-ce, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc52a7d72-ce, col_values=(('external_ids', {'iface-id': 'c52a7d72-ce8f-4795-ae56-6b9ec9366f0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:24:ac', 'vm-uuid': '16df9bdc-e946-4d1b-be3c-d460123b0fa5'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:28 user nova-compute[82850]: INFO os_vif [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce')
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:11:28 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No VIF found with MAC fa:16:3e:c5:24:ac, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:11:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:11:30 user nova-compute[82850]: WARNING nova.compute.manager [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287092.1635642, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:11:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Resumed (Lifecycle Event)
Apr 12 08:11:32 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance spawned successfully.
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:11:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287092.1639035, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:11:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Started (Lifecycle Event)
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:11:32 user nova-compute[82850]: WARNING nova.compute.manager [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 08:11:32 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:11:32 user nova-compute[82850]: DEBUG nova.compute.manager [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:11:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.643s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:11:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:11:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:11:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8405MB free_disk=26.016300201416016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:11:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [{"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-16df9bdc-e946-4d1b-be3c-d460123b0fa5" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:11:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:11:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:40 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:12:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:12:43 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:12:44 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=26.015522003173828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:12:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:12:45 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:12:46 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:12:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:12:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:12:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:12:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing instance network info cache due to event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Acquiring lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Acquired lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing network info cache for port ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:04 user nova-compute[82850]: INFO nova.compute.manager [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Attaching volume 563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 to /dev/vdb
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updated VIF entry in instance network info cache for port ee0639fa-801c-48ac-aa70-654e7f04ce3a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.network.neutron [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.utils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Releasing lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a560904e-76e5-4b2f-b075-a87ea1905f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c45ec1-328c-46fa-bd9d-b92720715691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2255c1b-983a-4595-9b77-d334c66d7419]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6658dd77-1c51-4b4a-afbc-a16bc42fa603]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:13:04 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:13:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e14b382-59ba-4c4e-95c2-c6c809004f00]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG os_brick.utils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:13:04 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating existing volume attachment record: 4e779cbd-c0c1-4664-b5e4-ed2c208b7a40 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:13:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:07 user nova-compute[82850]: INFO nova.compute.manager [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Detaching volume fcf45fc6-227c-4f48-8bd7-36232092aa61
Apr 12 08:13:07 user nova-compute[82850]: INFO nova.virt.block_device [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Attempting to driver detach volume fcf45fc6-227c-4f48-8bd7-36232092aa61 from mountpoint /dev/vdc
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Attempting to detach device vdc from instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:13:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:13:07 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:13:07 user nova-compute[82850]:   <target dev="vdc" bus="virtio"/>
Apr 12 08:13:07 user nova-compute[82850]:   <serial>fcf45fc6-227c-4f48-8bd7-36232092aa61</serial>
Apr 12 08:13:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 08:13:07 user nova-compute[82850]: </disk>
Apr 12 08:13:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:13:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully detached device vdc from instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 from the persistent domain config.
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:13:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:13:07 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:13:07 user nova-compute[82850]:   <target dev="vdc" bus="virtio"/>
Apr 12 08:13:07 user nova-compute[82850]:   <serial>fcf45fc6-227c-4f48-8bd7-36232092aa61</serial>
Apr 12 08:13:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 08:13:07 user nova-compute[82850]: </disk>
Apr 12 08:13:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681287187.7084053, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:13:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully detached device vdc from instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 from the live domain config.
Apr 12 08:13:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MulOkoUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:13:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8692b349-7ab9-4635-a5a4-1daa0c2a1b1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:13:07 user nova-compute[82850]: No targets found.
Apr 12 08:13:07 user nova-compute[82850]: iSNS:
Apr 12 08:13:07 user nova-compute[82850]: No targets found.
Apr 12 08:13:07 user nova-compute[82850]: STATIC:
Apr 12 08:13:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61
Apr 12 08:13:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:13:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:13:07 user nova-compute[82850]: FIRMWARE:
Apr 12 08:13:07 user nova-compute[82850]: No targets found.
Apr 12 08:13:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:13:07 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:13:07 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ee4cb-a7e4-452d-a38c-fa31651c0bbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e1ea5-f34c-412b-855c-e346a2bfd113]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)
Apr 12 08:13:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 (non-flash)
Apr 12 08:13:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f19342eb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d5b56-3a64-4359-9e78-4b278d93c585]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e4ee5c-28b9-498d-bdee-f34d8643249e]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[919dd499-9be4-4617-b294-c8c40aaf2f0e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f94fd7-9a1b-42df-81aa-e62851680622]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79647842-9bdd-4991-aa4a-9b7316d6f237]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b26c30-a7e7-4bd5-8aba-8ce13cbbc883]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260]
Apr 12 08:13:08 user nova-compute[82850]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61, portal: 172.16.0.220,3260] successful.
Apr 12 08:13:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf45fc6-227c-4f48-8bd7-36232092aa61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb768095-45c1-44bd-9e74-baf94fc2919b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] <== disconnect_volume: return (320ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'flavor' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:13:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLGdAVpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:13:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:13:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:13:09 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cc63a7-afb6-4d8f-834e-7f42e8d2fc46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:13:09 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e26f9-8052-418a-8932-4140d63ea854]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4] added
Apr 12 08:13:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b49fd-0c91-45d8-8f34-ce056bf2a05b]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe64f85-590c-4933-9936-3391b2b2273d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLGdAVpU {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLGdAVpU" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112c3a4-646d-41f1-bf3d-48b71ea69d07]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xLGdAVpU'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fdf7f-5d25-49cd-adf8-6e146a5df556]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a257e6-f499-4315-ad33-6f0d731d48e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:13:09 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:13:09 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:13:09 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:13:09 user nova-compute[82850]: 
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b93b76-fc0b-4e31-a5f8-920a7b8db430]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260]
Apr 12 08:13:09 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260] successful.
Apr 12 08:13:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabceb82-7e21-40f8-bd20-2c3dd632b5e0]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f2111-b235-48ea-8f78-5989a5598601]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)
Apr 12 08:13:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)
Apr 12 08:13:09 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874c45c-7b2e-4956-a8d7-ed8a2719d898]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:13:09 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLGdAVpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26532303730363664', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532303730363664', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.objects.instance [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 08:13:10 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:13:10 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:13:10 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:13:10 user nova-compute[82850]:   <serial>563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4</serial>
Apr 12 08:13:10 user nova-compute[82850]: </disk>
Apr 12 08:13:10 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] No VIF found with MAC fa:16:3e:fd:2d:99, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:13:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.239s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:11 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:11 user nova-compute[82850]: INFO nova.compute.manager [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Detaching volume 563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4
Apr 12 08:13:11 user nova-compute[82850]: INFO nova.virt.block_device [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Attempting to driver detach volume 563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 from mountpoint /dev/vdb
Apr 12 08:13:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Attempting to detach device vdb from instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:13:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:13:11 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:13:11 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:13:11 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:13:11 user nova-compute[82850]:   <serial>563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4</serial>
Apr 12 08:13:11 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:13:11 user nova-compute[82850]: </disk>
Apr 12 08:13:11 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:13:11 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully detached device vdb from instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 from the persistent domain config.
Apr 12 08:13:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:13:11 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:13:11 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:13:11 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:13:11 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:13:11 user nova-compute[82850]:   <serial>563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4</serial>
Apr 12 08:13:11 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:13:11 user nova-compute[82850]: </disk>
Apr 12 08:13:11 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681287192.2116065, 0c151ba7-5711-44f0-aa2a-10b26dc77474 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:13:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully detached device vdb from instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 from the live domain config.
Apr 12 08:13:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLGdAVpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:13:12 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24c963-c2a7-40b7-9c61-6a64bfa76988]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:13:12 user nova-compute[82850]: No targets found.
Apr 12 08:13:12 user nova-compute[82850]: iSNS:
Apr 12 08:13:12 user nova-compute[82850]: No targets found.
Apr 12 08:13:12 user nova-compute[82850]: STATIC:
Apr 12 08:13:12 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4
Apr 12 08:13:12 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:13:12 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:13:12 user nova-compute[82850]: FIRMWARE:
Apr 12 08:13:12 user nova-compute[82850]: No targets found.
Apr 12 08:13:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:13:12 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:13:12 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd54e46-3198-4cab-bf8b-ccd3da5073ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93240cd-776c-4a0a-bfd1-1b14056eb58f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)
Apr 12 08:13:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 (non-flash)
Apr 12 08:13:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1951f6ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6053cd85-202f-4769-858f-b833c168c470]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c355d-914c-4538-8443-a12cde0407cc]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[49140fc0-12d1-42e8-9d5c-802c27bcaf0d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c7659-b6bf-4f83-8e38-9e1e72aeb93b]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d2bfdd-0c3e-46e0-9814-59adbb73ebc4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6413d0-3bc9-4abd-a8cf-42973f585586]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260]
Apr 12 08:13:12 user nova-compute[82850]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4, portal: 172.16.0.220,3260] successful.
Apr 12 08:13:12 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e536b-7b7e-4595-8518-1f9f374320e2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] <== disconnect_volume: return (305ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:13:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:13:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'flavor' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:13:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:13:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:37 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:40 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:40 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:13:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:13:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:13:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:13:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=25.998798370361328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:13:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:13:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:13:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:57 user nova-compute[82850]: INFO nova.compute.manager [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Terminating instance
Apr 12 08:13:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:13:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-unplugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:13:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Instance destroyed successfully.
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'resources' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1715890719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1715890719',id=40,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGUsZk+0FFRlxN7ot18soKqADFCkS7i/wDGGcWd/SeiRgvm3dHu7GHBm8NFwvIgAzAthDChntTADY+w7rAzzxwPIbXCJPKJLjzBnPTlb5heDyZwU3YMzanBVuqyf5fx2A==',key_name='tempest-keypair-1482956523',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-c1y8zvb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=16df9bdc-e946-4d1b-be3c-d460123b0fa5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "address": "fa:16:3e:c5:24:ac", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52a7d72-ce", "ovs_interfaceid": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG os_vif [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc52a7d72-ce, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:13:58 user nova-compute[82850]: INFO os_vif [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:24:ac,bridge_name='br-int',has_traffic_filtering=True,id=c52a7d72-ce8f-4795-ae56-6b9ec9366f0a,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52a7d72-ce')
Apr 12 08:13:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Deleting instance files /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5_del
Apr 12 08:13:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Deletion of /opt/stack/data/nova/instances/16df9bdc-e946-4d1b-be3c-d460123b0fa5_del complete
Apr 12 08:13:58 user nova-compute[82850]: INFO nova.compute.manager [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 08:13:58 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:13:58 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:13:59 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Took 1.09 seconds to deallocate network for instance.
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-deleted-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:59 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Deleted allocations for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Acquiring lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Lock "16df9bdc-e946-4d1b-be3c-d460123b0fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:13:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] No waiting events found dispatching network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:13:59 user nova-compute[82850]: WARNING nova.compute.manager [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Received unexpected event network-vif-plugged-c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance with vm_state deleted and task_state None.
Apr 12 08:14:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing instance network info cache due to event network-changed-ee0639fa-801c-48ac-aa70-654e7f04ce3a. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Acquiring lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Acquired lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.network.neutron [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Refreshing network info cache for port ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:02 user nova-compute[82850]: INFO nova.compute.manager [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Terminating instance
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-unplugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] No waiting events found dispatching network-vif-unplugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG nova.compute.manager [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-unplugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updated VIF entry in instance network info cache for port ee0639fa-801c-48ac-aa70-654e7f04ce3a. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [{"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Releasing lock "refresh_cache-0c151ba7-5711-44f0-aa2a-10b26dc77474" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Instance destroyed successfully.
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.objects.instance [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'resources' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086621763',display_name='tempest-TestStampPattern-server-1086621763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086621763',id=42,image_ref='5849deaf-c4ba-409a-b228-b19d3ac3cca8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-co9mz602',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='43d46682-0451-46c3-88f7-4dd09d0cd4e9',image_min_disk='1',image_min_ram='0',image_owner_id='d2abfb00bf93470c9e71aa01f477ccf7',image_owner_project_name='tempest-TestStampPattern-1602124066',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1602124066-project-member',image_user_id='97536e3b50284fbc81a9188166e90a7a',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:11:19Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=0c151ba7-5711-44f0-aa2a-10b26dc77474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "address": "fa:16:3e:fd:2d:99", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0639fa-80", "ovs_interfaceid": "ee0639fa-801c-48ac-aa70-654e7f04ce3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG os_vif [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0639fa-80, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:03 user nova-compute[82850]: INFO os_vif [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:2d:99,bridge_name='br-int',has_traffic_filtering=True,id=ee0639fa-801c-48ac-aa70-654e7f04ce3a,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0639fa-80')
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Deleting instance files /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474_del
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Deletion of /opt/stack/data/nova/instances/0c151ba7-5711-44f0-aa2a-10b26dc77474_del complete
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.compute.manager [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 08:14:03 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Took 0.45 seconds to deallocate network for instance.
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-deleted-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:03 user nova-compute[82850]: INFO nova.compute.manager [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Neutron deleted interface ee0639fa-801c-48ac-aa70-654e7f04ce3a; detaching it from the instance and deleting it from the info cache
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.network.neutron [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.compute.manager [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Detach interface failed, port_id=ee0639fa-801c-48ac-aa70-654e7f04ce3a, reason: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:03 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:04 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Deleted allocations for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474
Apr 12 08:14:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Acquiring lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Lock "0c151ba7-5711-44f0-aa2a-10b26dc77474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:04 user nova-compute[82850]: DEBUG nova.compute.manager [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] No waiting events found dispatching network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:14:04 user nova-compute[82850]: WARNING nova.compute.manager [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Received unexpected event network-vif-plugged-ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance with vm_state deleted and task_state None.
Apr 12 08:14:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:13 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287238.2225296, 16df9bdc-e946-4d1b-be3c-d460123b0fa5 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:14:13 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] VM Stopped (Lifecycle Event)
Apr 12 08:14:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-19628bab-b206-45ac-801e-ab429c27da27 None None] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:14:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:18 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287243.3024495, 0c151ba7-5711-44f0-aa2a-10b26dc77474 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:14:18 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] VM Stopped (Lifecycle Event)
Apr 12 08:14:18 user nova-compute[82850]: DEBUG nova.compute.manager [None req-dc9fd097-c378-44eb-9040-0bec2f9b1b28 None None] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:14:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:14:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:38 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:14:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:14:45 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=26.018638610839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:14:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:14:46 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:14:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:14:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:14:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:14:51 user nova-compute[82850]: INFO nova.compute.claims [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Claim successful on node user
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:14:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.policy [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:14:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Creating image(s)
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk 1073741824" returned: 0 in 0.059s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Cannot resize image /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'migration_context' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Ensure instance console log exists: /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Successfully created port: a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:14:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Successfully updated port: a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing instance network info cache due to event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance network_info: |[{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start _get_guest_xml network_info=[{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:14:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:14:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1177QTZ6MOY/ghf5gm4WSJ+rW3qHfiCub3ZmOIsRJl6gDzY3JWjWt/0WwzyMHLZLZhU7VCJU3PZEivJ5/58oTtdiMBwCkXNtMnr8epnanBcFIAxd8nh14cO/1ziLz65w==',key_name='tempest-keypair-1362819448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_devices' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:14:53 user nova-compute[82850]:   <uuid>c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</uuid>
Apr 12 08:14:53 user nova-compute[82850]:   <name>instance-0000002b</name>
Apr 12 08:14:53 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:14:53 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:14:53 user nova-compute[82850]:   <metadata>
Apr 12 08:14:53 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:14:53 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1054995483</nova:name>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:14:53</nova:creationTime>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:14:53 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:14:53 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:owner>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:user uuid="705c265380f543848a986352fa2e385c">tempest-AttachVolumeShelveTestJSON-1176597283-project-member</nova:user>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:project uuid="0eca5169ebeb49208b99a1aba27b8f2d">tempest-AttachVolumeShelveTestJSON-1176597283</nova:project>
Apr 12 08:14:53 user nova-compute[82850]:       </nova:owner>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:14:53 user nova-compute[82850]:       <nova:ports>
Apr 12 08:14:53 user nova-compute[82850]:         <nova:port uuid="a0a795c9-9852-407c-86c0-713846c39f6c">
Apr 12 08:14:53 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 08:14:53 user nova-compute[82850]:         </nova:port>
Apr 12 08:14:53 user nova-compute[82850]:       </nova:ports>
Apr 12 08:14:53 user nova-compute[82850]:     </nova:instance>
Apr 12 08:14:53 user nova-compute[82850]:   </metadata>
Apr 12 08:14:53 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:14:53 user nova-compute[82850]:     <system>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="serial">c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</entry>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="uuid">c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</entry>
Apr 12 08:14:53 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:14:53 user nova-compute[82850]:     </system>
Apr 12 08:14:53 user nova-compute[82850]:   </sysinfo>
Apr 12 08:14:53 user nova-compute[82850]:   <os>
Apr 12 08:14:53 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:14:53 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:14:53 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:14:53 user nova-compute[82850]:   </os>
Apr 12 08:14:53 user nova-compute[82850]:   <features>
Apr 12 08:14:53 user nova-compute[82850]:     <acpi/>
Apr 12 08:14:53 user nova-compute[82850]:     <apic/>
Apr 12 08:14:53 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:14:53 user nova-compute[82850]:   </features>
Apr 12 08:14:53 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:14:53 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:14:53 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:14:53 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:14:53 user nova-compute[82850]:   </clock>
Apr 12 08:14:53 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:14:53 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:14:53 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:14:53 user nova-compute[82850]:   </cpu>
Apr 12 08:14:53 user nova-compute[82850]:   <devices>
Apr 12 08:14:53 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:14:53 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:14:53 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk"/>
Apr 12 08:14:53 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:14:53 user nova-compute[82850]:     </disk>
Apr 12 08:14:53 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:14:53 user nova-compute[82850]:       <mac address="fa:16:3e:6c:7a:39"/>
Apr 12 08:14:53 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:14:53 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:14:53 user nova-compute[82850]:       <target dev="tapa0a795c9-98"/>
Apr 12 08:14:53 user nova-compute[82850]:     </interface>
Apr 12 08:14:53 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:14:53 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/console.log" append="off"/>
Apr 12 08:14:53 user nova-compute[82850]:     </serial>
Apr 12 08:14:53 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:14:53 user nova-compute[82850]:     <video>
Apr 12 08:14:53 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:14:53 user nova-compute[82850]:     </video>
Apr 12 08:14:53 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:14:53 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:14:53 user nova-compute[82850]:     </rng>
Apr 12 08:14:53 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:14:53 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:14:53 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:14:53 user nova-compute[82850]:     </memballoon>
Apr 12 08:14:53 user nova-compute[82850]:   </devices>
Apr 12 08:14:53 user nova-compute[82850]: </domain>
Apr 12 08:14:53 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1177QTZ6MOY/ghf5gm4WSJ+rW3qHfiCub3ZmOIsRJl6gDzY3JWjWt/0WwzyMHLZLZhU7VCJU3PZEivJ5/58oTtdiMBwCkXNtMnr8epnanBcFIAxd8nh14cO/1ziLz65w==',key_name='tempest-keypair-1362819448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG os_vif [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a795c9-98, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0a795c9-98, col_values=(('external_ids', {'iface-id': 'a0a795c9-9852-407c-86c0-713846c39f6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:7a:39', 'vm-uuid': 'c10ac230-4a78-4cae-a6e8-6a2b97c0fe25'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:53 user nova-compute[82850]: INFO os_vif [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98')
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No VIF found with MAC fa:16:3e:6c:7a:39, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated VIF entry in instance network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:14:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:14:55 user nova-compute[82850]: WARNING nova.compute.manager [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state building and task_state spawning.
Apr 12 08:14:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287297.0344305, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Resumed (Lifecycle Event)
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance spawned successfully.
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287297.035668, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Started (Lifecycle Event)
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:14:57 user nova-compute[82850]: WARNING nova.compute.manager [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state building and task_state spawning.
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 12 08:14:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:14:57 user nova-compute[82850]: INFO nova.compute.manager [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Took 6.01 seconds to build instance.
Apr 12 08:14:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.118s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing instance network info cache due to event network-changed-3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Acquiring lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Acquired lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Refreshing network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:58 user nova-compute[82850]: INFO nova.compute.manager [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Terminating instance
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updated VIF entry in instance network info cache for port 3b60e3e3-a92c-40bb-bed4-796cdbd6074e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG nova.network.neutron [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [{"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Releasing lock "refresh_cache-43d46682-0451-46c3-88f7-4dd09d0cd4e9" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Instance destroyed successfully.
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'resources' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015532211',display_name='tempest-TestStampPattern-server-2015532211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015532211',id=41,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q==',key_name='tempest-TestStampPattern-598492705',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:08:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2abfb00bf93470c9e71aa01f477ccf7',ramdisk_id='',reservation_id='r-omjkmy98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1602124066',owner_user_name='tempest-TestStampPattern-1602124066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:11:08Z,user_data=None,user_id='97536e3b50284fbc81a9188166e90a7a',uuid=43d46682-0451-46c3-88f7-4dd09d0cd4e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converting VIF {"id": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "address": "fa:16:3e:ee:d5:16", "network": {"id": "04a0ab6e-5794-4409-9c51-d6debd57a18b", "bridge": "br-int", "label": "tempest-TestStampPattern-2066593412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2abfb00bf93470c9e71aa01f477ccf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b60e3e3-a9", "ovs_interfaceid": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG os_vif [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b60e3e3-a9, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:14:59 user nova-compute[82850]: INFO os_vif [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:d5:16,bridge_name='br-int',has_traffic_filtering=True,id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e,network=Network(04a0ab6e-5794-4409-9c51-d6debd57a18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b60e3e3-a9')
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Deleting instance files /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9_del
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Deletion of /opt/stack/data/nova/instances/43d46682-0451-46c3-88f7-4dd09d0cd4e9_del complete
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.compute.manager [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 08:14:59 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Took 0.49 seconds to deallocate network for instance.
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-vif-deleted-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.compute.manager [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Neutron deleted interface 3b60e3e3-a92c-40bb-bed4-796cdbd6074e; detaching it from the instance and deleting it from the info cache
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.network.neutron [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.compute.manager [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Detach interface failed, port_id=3b60e3e3-a92c-40bb-bed4-796cdbd6074e, reason: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. {{(pid=82850) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:14:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:14:59 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Deleted allocations for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9
Apr 12 08:14:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-vif-unplugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] No waiting events found dispatching network-vif-unplugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:15:00 user nova-compute[82850]: WARNING nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received unexpected event network-vif-unplugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance with vm_state deleted and task_state None.
Apr 12 08:15:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Acquiring lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "43d46682-0451-46c3-88f7-4dd09d0cd4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] No waiting events found dispatching network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:15:00 user nova-compute[82850]: WARNING nova.compute.manager [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Received unexpected event network-vif-plugged-3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance with vm_state deleted and task_state None.
Apr 12 08:15:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Verify base images {{(pid=82850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Image id 68a0a523-85da-4c40-ac88-5d5f304c0b18 yields fingerprint 9c629b490f6d7574974a312e45ed199fccc05b81 {{(pid=82850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] image 68a0a523-85da-4c40-ac88-5d5f304c0b18 at (/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81): checking
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] image 68a0a523-85da-4c40-ac88-5d5f304c0b18 at (/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81): image is in use {{(pid=82850) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 is a valid instance name {{(pid=82850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 has a disk file {{(pid=82850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 is backed by 9c629b490f6d7574974a312e45ed199fccc05b81 {{(pid=82850) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a
Apr 12 08:15:05 user nova-compute[82850]: WARNING nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Active base files: /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Removable base files: /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68 /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681 /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93 /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cd1f99e1db6af5ee60c11f02b30877912d7f3d0f
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f7fb2ffc338a71f1674a705c28c290696039ee68
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cd31a4add0f0c9d509fff5d5fa4980fcb0424a1d
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/90ae9eea9559400f964a68521d7b7b5b20d34681
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d33bce93a0051fc0594f54cadebe701cac7f69ff
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8a438427d9d1cea2d68f3e10f53d6013a25f9c93
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e71f764056e148ff65c1a51f070678664b752c7a
Apr 12 08:15:05 user nova-compute[82850]: INFO nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d2516bfd3bf80ee84506dbdd0f305c1747c6bc4f
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Verification complete {{(pid=82850) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Verify swap images {{(pid=82850) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 08:15:05 user nova-compute[82850]: DEBUG nova.virt.libvirt.imagecache [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Verify ephemeral images {{(pid=82850) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 08:15:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:15:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:14 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287299.0397706, 43d46682-0451-46c3-88f7-4dd09d0cd4e9 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:15:14 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] VM Stopped (Lifecycle Event)
Apr 12 08:15:14 user nova-compute[82850]: DEBUG nova.compute.manager [None req-5d5fa836-267a-455a-9255-51adcbcd859a None None] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:15:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:15:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:39 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:15:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:15:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:15:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:15:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=26.08850860595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:15:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:15:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:15:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:15:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:15:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:15:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:15:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:15:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:16:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:13 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:16:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:35 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:35 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 08:16:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:35 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing instance network info cache due to event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:16:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:16:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated VIF entry in instance network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:16:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:16:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:44 user nova-compute[82850]: INFO nova.compute.manager [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Shelving
Apr 12 08:16:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:16:44 user nova-compute[82850]: WARNING nova.compute.manager [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state shelving.
Apr 12 08:16:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance destroyed successfully.
Apr 12 08:16:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Beginning cold snapshot process
Apr 12 08:16:45 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk /opt/stack/data/nova/instances/snapshots/tmpqnd6vuz7/58d27e77498c4e3095dddb12d25e531b {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk /opt/stack/data/nova/instances/snapshots/tmpqnd6vuz7/58d27e77498c4e3095dddb12d25e531b" returned: 0 in 0.209s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:16:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Snapshot extracted, beginning image upload
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:16:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:16:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=26.043323516845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:16:46 user nova-compute[82850]: WARNING nova.compute.manager [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 08:16:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Snapshot image upload complete
Apr 12 08:16:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:16:47 user nova-compute[82850]: INFO nova.compute.manager [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Shelve offloading
Apr 12 08:16:47 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance destroyed successfully.
Apr 12 08:16:47 user nova-compute[82850]: DEBUG nova.compute.manager [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:16:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:16:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:16:47 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance destroyed successfully.
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'resources' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1177QTZ6MOY/ghf5gm4WSJ+rW3qHfiCub3ZmOIsRJl6gDzY3JWjWt/0WwzyMHLZLZhU7VCJU3PZEivJ5/58oTtdiMBwCkXNtMnr8epnanBcFIAxd8nh14cO/1ziLz65w==',key_name='tempest-keypair-1362819448',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:16:47.777446',shelved_host='user',shelved_image_id='72d08ed8-2e4f-4d30-8763-ba040640919e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG os_vif [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a795c9-98, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG nova.compute.manager [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing instance network info cache due to event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:16:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:16:48 user nova-compute[82850]: INFO os_vif [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98')
Apr 12 08:16:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Deleting instance files /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25_del
Apr 12 08:16:48 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Deletion of /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25_del complete
Apr 12 08:16:49 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Deleted allocations for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'numa_topology' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 4.952s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa0a795c9-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.network.neutron [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.network.neutron [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated VIF entry in instance network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG nova.network.neutron [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa0a795c9-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:16:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:16:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:16:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:16:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:00 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287405.0833662, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:17:00 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Stopped (Lifecycle Event)
Apr 12 08:17:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-e14dd039-4be5-4d87-a8aa-4d4a6a50eca9 None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:17:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:42 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:17:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:17:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:17:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:17:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:17:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=26.062274932861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:17:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:17:47 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:17:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:17:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:17:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:17:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:17:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:36 user nova-compute[82850]: INFO nova.compute.manager [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Unshelving
Apr 12 08:18:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_requests' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'numa_topology' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:18:37 user nova-compute[82850]: INFO nova.compute.claims [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Claim successful on node user
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:37 user nova-compute[82850]: INFO nova.network.neutron [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating port a0a795c9-9852-407c-86c0-713846c39f6c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:18:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing instance network info cache due to event network-changed-a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:18:38 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Creating image(s)
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'trusted_certs' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG nova.network.neutron [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Refreshing network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.part --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.part --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG nova.virt.images [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 72d08ed8-2e4f-4d30-8763-ba040640919e was qcow2, converting to raw {{(pid=82850) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG nova.privsep.utils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82850) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.part /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.converted {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.part /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.converted" returned: 0 in 0.228s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.converted --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated VIF entry in instance network info cache for port a0a795c9-9852-407c-86c0-713846c39f6c. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.153s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json" returned: 0 in 0.127s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e,backing_fmt=raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e,backing_fmt=raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk 1073741824" returned: 0 in 0.048s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "88f5af47ec6f154657ef5a85ba982b5dd229d48e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88f5af47ec6f154657ef5a85ba982b5dd229d48e --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'migration_context' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:40 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Rebasing disk image.
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 -F raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 -F raw /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk" returned: 0 in 1.867s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Ensure instance console log exists: /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start _get_guest_xml network_info=[{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4016f535934b017b2d5c79546f110bef',container_format='bare',created_at=2023-04-12T08:16:44Z,direct_url=<?>,disk_format='qcow2',id=72d08ed8-2e4f-4d30-8763-ba040640919e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1054995483-shelved',owner='0eca5169ebeb49208b99a1aba27b8f2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T08:16:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:18:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:18:42 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4016f535934b017b2d5c79546f110bef',container_format='bare',created_at=2023-04-12T08:16:44Z,direct_url=<?>,disk_format='qcow2',id=72d08ed8-2e4f-4d30-8763-ba040640919e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1054995483-shelved',owner='0eca5169ebeb49208b99a1aba27b8f2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T08:16:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'vcpu_model' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='72d08ed8-2e4f-4d30-8763-ba040640919e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1362819448',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:16:47.777446',shelved_host='user',shelved_image_id='72d08ed8-2e4f-4d30-8763-ba040640919e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'pci_devices' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:18:42 user nova-compute[82850]:   <uuid>c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</uuid>
Apr 12 08:18:42 user nova-compute[82850]:   <name>instance-0000002b</name>
Apr 12 08:18:42 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:18:42 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:18:42 user nova-compute[82850]:   <metadata>
Apr 12 08:18:42 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:18:42 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1054995483</nova:name>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:18:42</nova:creationTime>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:18:42 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:18:42 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:owner>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:user uuid="705c265380f543848a986352fa2e385c">tempest-AttachVolumeShelveTestJSON-1176597283-project-member</nova:user>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:project uuid="0eca5169ebeb49208b99a1aba27b8f2d">tempest-AttachVolumeShelveTestJSON-1176597283</nova:project>
Apr 12 08:18:42 user nova-compute[82850]:       </nova:owner>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:root type="image" uuid="72d08ed8-2e4f-4d30-8763-ba040640919e"/>
Apr 12 08:18:42 user nova-compute[82850]:       <nova:ports>
Apr 12 08:18:42 user nova-compute[82850]:         <nova:port uuid="a0a795c9-9852-407c-86c0-713846c39f6c">
Apr 12 08:18:42 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 08:18:42 user nova-compute[82850]:         </nova:port>
Apr 12 08:18:42 user nova-compute[82850]:       </nova:ports>
Apr 12 08:18:42 user nova-compute[82850]:     </nova:instance>
Apr 12 08:18:42 user nova-compute[82850]:   </metadata>
Apr 12 08:18:42 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:18:42 user nova-compute[82850]:     <system>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="serial">c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</entry>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="uuid">c10ac230-4a78-4cae-a6e8-6a2b97c0fe25</entry>
Apr 12 08:18:42 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:18:42 user nova-compute[82850]:     </system>
Apr 12 08:18:42 user nova-compute[82850]:   </sysinfo>
Apr 12 08:18:42 user nova-compute[82850]:   <os>
Apr 12 08:18:42 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:18:42 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:18:42 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:18:42 user nova-compute[82850]:   </os>
Apr 12 08:18:42 user nova-compute[82850]:   <features>
Apr 12 08:18:42 user nova-compute[82850]:     <acpi/>
Apr 12 08:18:42 user nova-compute[82850]:     <apic/>
Apr 12 08:18:42 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:18:42 user nova-compute[82850]:   </features>
Apr 12 08:18:42 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:18:42 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:18:42 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:18:42 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:18:42 user nova-compute[82850]:   </clock>
Apr 12 08:18:42 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:18:42 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:18:42 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:18:42 user nova-compute[82850]:   </cpu>
Apr 12 08:18:42 user nova-compute[82850]:   <devices>
Apr 12 08:18:42 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:18:42 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:18:42 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk"/>
Apr 12 08:18:42 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:18:42 user nova-compute[82850]:     </disk>
Apr 12 08:18:42 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:18:42 user nova-compute[82850]:       <mac address="fa:16:3e:6c:7a:39"/>
Apr 12 08:18:42 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:18:42 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:18:42 user nova-compute[82850]:       <target dev="tapa0a795c9-98"/>
Apr 12 08:18:42 user nova-compute[82850]:     </interface>
Apr 12 08:18:42 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:18:42 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/console.log" append="off"/>
Apr 12 08:18:42 user nova-compute[82850]:     </serial>
Apr 12 08:18:42 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:18:42 user nova-compute[82850]:     <video>
Apr 12 08:18:42 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:18:42 user nova-compute[82850]:     </video>
Apr 12 08:18:42 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:18:42 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:18:42 user nova-compute[82850]:     </rng>
Apr 12 08:18:42 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:18:42 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:18:42 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:18:42 user nova-compute[82850]:     </memballoon>
Apr 12 08:18:42 user nova-compute[82850]:   </devices>
Apr 12 08:18:42 user nova-compute[82850]: </domain>
Apr 12 08:18:42 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='72d08ed8-2e4f-4d30-8763-ba040640919e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1362819448',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member',shelved_at='2023-04-12T08:16:47.777446',shelved_host='user',shelved_image_id='72d08ed8-2e4f-4d30-8763-ba040640919e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG os_vif [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a795c9-98, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0a795c9-98, col_values=(('external_ids', {'iface-id': 'a0a795c9-9852-407c-86c0-713846c39f6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:7a:39', 'vm-uuid': 'c10ac230-4a78-4cae-a6e8-6a2b97c0fe25'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:42 user nova-compute[82850]: INFO os_vif [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98')
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:18:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] No VIF found with MAC fa:16:3e:6c:7a:39, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:18:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG nova.compute.manager [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:18:44 user nova-compute[82850]: WARNING nova.compute.manager [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 08:18:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:44 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:45 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:18:46 user nova-compute[82850]: WARNING nova.compute.manager [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 08:18:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287526.3368285, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:18:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Resumed (Lifecycle Event)
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:18:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:18:46 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.972412109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:18:46 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance spawned successfully.
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:18:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287526.3388486, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:18:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Started (Lifecycle Event)
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (27ffe403-b11c-48c3-a0f8-372b48def01d): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:18:46 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:18:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.904s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:18:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:18:49 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:18:50 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:18:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:18:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:18:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:18:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:45 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:19:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:19:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:19:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=26.043319702148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:19:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:19:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:19:51 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:19:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [{"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:19:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:19:52 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:19:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:19:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:19:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:20:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:27 user nova-compute[82850]: INFO nova.compute.manager [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Terminating instance
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.compute.manager [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Instance destroyed successfully.
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'resources' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T08:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1054995483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1054995483',id=43,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1177QTZ6MOY/ghf5gm4WSJ+rW3qHfiCub3ZmOIsRJl6gDzY3JWjWt/0WwzyMHLZLZhU7VCJU3PZEivJ5/58oTtdiMBwCkXNtMnr8epnanBcFIAxd8nh14cO/1ziLz65w==',key_name='tempest-keypair-1362819448',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eca5169ebeb49208b99a1aba27b8f2d',ramdisk_id='',reservation_id='r-1dlv9zta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1176597283',owner_user_name='tempest-AttachVolumeShelveTestJSON-1176597283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:18:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='705c265380f543848a986352fa2e385c',uuid=c10ac230-4a78-4cae-a6e8-6a2b97c0fe25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converting VIF {"id": "a0a795c9-9852-407c-86c0-713846c39f6c", "address": "fa:16:3e:6c:7a:39", "network": {"id": "008fc615-654d-414f-bc6f-fe11af903e1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-187003551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca5169ebeb49208b99a1aba27b8f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a795c9-98", "ovs_interfaceid": "a0a795c9-9852-407c-86c0-713846c39f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG os_vif [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a795c9-98, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:27 user nova-compute[82850]: INFO os_vif [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:7a:39,bridge_name='br-int',has_traffic_filtering=True,id=a0a795c9-9852-407c-86c0-713846c39f6c,network=Network(008fc615-654d-414f-bc6f-fe11af903e1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a795c9-98')
Apr 12 08:20:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Deleting instance files /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25_del
Apr 12 08:20:27 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Deletion of /opt/stack/data/nova/instances/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25_del complete
Apr 12 08:20:28 user nova-compute[82850]: INFO nova.compute.manager [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 08:20:28 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:29 user nova-compute[82850]: WARNING nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state deleting.
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:29 user nova-compute[82850]: WARNING nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state deleting.
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:29 user nova-compute[82850]: WARNING nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state deleting.
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-unplugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] No waiting events found dispatching network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:20:29 user nova-compute[82850]: WARNING nova.compute.manager [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received unexpected event network-vif-plugged-a0a795c9-9852-407c-86c0-713846c39f6c for instance with vm_state active and task_state deleting.
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:20:29 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Took 1.64 seconds to deallocate network for instance.
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:29 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Deleted allocations for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25
Apr 12 08:20:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:31 user nova-compute[82850]: DEBUG nova.compute.manager [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Received event network-vif-deleted-a0a795c9-9852-407c-86c0-713846c39f6c {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:20:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:42 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287627.911896, c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:20:42 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] VM Stopped (Lifecycle Event)
Apr 12 08:20:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-2da10d8e-cf14-46eb-a0cb-84a01341d79a None None] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:20:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:20:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:20:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=26.06226348876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:20:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:20:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:20:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:20:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:20:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:20:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:20:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:20:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:20:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:21:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:21:37 user nova-compute[82850]: INFO nova.compute.claims [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Claim successful on node user
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:21:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.policy [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:21:37 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Creating image(s)
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk 1073741824" returned: 0 in 0.061s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Successfully created port: cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Cannot resize image /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'migration_context' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Ensure instance console log exists: /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Successfully updated port: cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-changed-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.compute.manager [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Refreshing instance network info cache due to event network-changed-cfe0247e-840a-4599-a280-dabc36db725e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:21:38 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Instance network_info: |[{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Refreshing network info cache for port cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Start _get_guest_xml network_info=[{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:21:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:21:39 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-285957137',display_name='tempest-AttachVolumeNegativeTest-server-285957137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-285957137',id=44,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm1iDAsrc5nn5HZ4c1S2/5BQYY9OlMCCqludw0R7nIsR4rOX1g1NGeT0qKEvePSLaBIvNw+MxhrHLfdqFpCA8NgOH4lVOQi4JLS7OyBU4zU694ItIO3yoJ/KXTGUqpZ2w==',key_name='tempest-keypair-177521254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-fbs891w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=3d081049-b4cf-4ae7-b1ee-9961c9b900c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:21:39 user nova-compute[82850]:   <uuid>3d081049-b4cf-4ae7-b1ee-9961c9b900c0</uuid>
Apr 12 08:21:39 user nova-compute[82850]:   <name>instance-0000002c</name>
Apr 12 08:21:39 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:21:39 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:21:39 user nova-compute[82850]:   <metadata>
Apr 12 08:21:39 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:21:39 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-285957137</nova:name>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:21:39</nova:creationTime>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:21:39 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:21:39 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:owner>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:user uuid="bc8316aee1bb41ef99be6777924a33d8">tempest-AttachVolumeNegativeTest-1980986093-project-member</nova:user>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:project uuid="a47cb4fc9e2640399e7df51f12de123d">tempest-AttachVolumeNegativeTest-1980986093</nova:project>
Apr 12 08:21:39 user nova-compute[82850]:       </nova:owner>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:21:39 user nova-compute[82850]:       <nova:ports>
Apr 12 08:21:39 user nova-compute[82850]:         <nova:port uuid="cfe0247e-840a-4599-a280-dabc36db725e">
Apr 12 08:21:39 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 08:21:39 user nova-compute[82850]:         </nova:port>
Apr 12 08:21:39 user nova-compute[82850]:       </nova:ports>
Apr 12 08:21:39 user nova-compute[82850]:     </nova:instance>
Apr 12 08:21:39 user nova-compute[82850]:   </metadata>
Apr 12 08:21:39 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:21:39 user nova-compute[82850]:     <system>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="serial">3d081049-b4cf-4ae7-b1ee-9961c9b900c0</entry>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="uuid">3d081049-b4cf-4ae7-b1ee-9961c9b900c0</entry>
Apr 12 08:21:39 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:21:39 user nova-compute[82850]:     </system>
Apr 12 08:21:39 user nova-compute[82850]:   </sysinfo>
Apr 12 08:21:39 user nova-compute[82850]:   <os>
Apr 12 08:21:39 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:21:39 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:21:39 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:21:39 user nova-compute[82850]:   </os>
Apr 12 08:21:39 user nova-compute[82850]:   <features>
Apr 12 08:21:39 user nova-compute[82850]:     <acpi/>
Apr 12 08:21:39 user nova-compute[82850]:     <apic/>
Apr 12 08:21:39 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:21:39 user nova-compute[82850]:   </features>
Apr 12 08:21:39 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:21:39 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:21:39 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:21:39 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:21:39 user nova-compute[82850]:   </clock>
Apr 12 08:21:39 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:21:39 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:21:39 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:21:39 user nova-compute[82850]:   </cpu>
Apr 12 08:21:39 user nova-compute[82850]:   <devices>
Apr 12 08:21:39 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:21:39 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:21:39 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk"/>
Apr 12 08:21:39 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:21:39 user nova-compute[82850]:     </disk>
Apr 12 08:21:39 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:21:39 user nova-compute[82850]:       <mac address="fa:16:3e:7c:24:54"/>
Apr 12 08:21:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:21:39 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:21:39 user nova-compute[82850]:       <target dev="tapcfe0247e-84"/>
Apr 12 08:21:39 user nova-compute[82850]:     </interface>
Apr 12 08:21:39 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:21:39 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/console.log" append="off"/>
Apr 12 08:21:39 user nova-compute[82850]:     </serial>
Apr 12 08:21:39 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:21:39 user nova-compute[82850]:     <video>
Apr 12 08:21:39 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:21:39 user nova-compute[82850]:     </video>
Apr 12 08:21:39 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:21:39 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:21:39 user nova-compute[82850]:     </rng>
Apr 12 08:21:39 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:21:39 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:21:39 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:21:39 user nova-compute[82850]:     </memballoon>
Apr 12 08:21:39 user nova-compute[82850]:   </devices>
Apr 12 08:21:39 user nova-compute[82850]: </domain>
Apr 12 08:21:39 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-285957137',display_name='tempest-AttachVolumeNegativeTest-server-285957137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-285957137',id=44,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm1iDAsrc5nn5HZ4c1S2/5BQYY9OlMCCqludw0R7nIsR4rOX1g1NGeT0qKEvePSLaBIvNw+MxhrHLfdqFpCA8NgOH4lVOQi4JLS7OyBU4zU694ItIO3yoJ/KXTGUqpZ2w==',key_name='tempest-keypair-177521254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-fbs891w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=3d081049-b4cf-4ae7-b1ee-9961c9b900c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG os_vif [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfe0247e-84, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfe0247e-84, col_values=(('external_ids', {'iface-id': 'cfe0247e-840a-4599-a280-dabc36db725e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:24:54', 'vm-uuid': '3d081049-b4cf-4ae7-b1ee-9961c9b900c0'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:39 user nova-compute[82850]: INFO os_vif [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84')
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:7c:24:54, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated VIF entry in instance network info cache for port cfe0247e-840a-4599-a280-dabc36db725e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG nova.network.neutron [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:21:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:40 user nova-compute[82850]: DEBUG nova.compute.manager [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] No waiting events found dispatching network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:21:40 user nova-compute[82850]: WARNING nova.compute.manager [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received unexpected event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e for instance with vm_state building and task_state spawning.
Apr 12 08:21:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287702.742648, 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] VM Resumed (Lifecycle Event)
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Instance spawned successfully.
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287702.7462857, 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] VM Started (Lifecycle Event)
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:21:42 user nova-compute[82850]: INFO nova.compute.manager [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Took 5.81 seconds to build instance.
Apr 12 08:21:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.899s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] No waiting events found dispatching network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:21:42 user nova-compute[82850]: WARNING nova.compute.manager [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received unexpected event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e for instance with vm_state active and task_state None.
Apr 12 08:21:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:46 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:21:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:21:47 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=26.059494018554688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:21:47 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:21:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:21:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:21:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:21:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:21:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:22:44 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:22:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:49 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:22:49 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=26.03927230834961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:22:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:22:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:22:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:22:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:22:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:22:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:22:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:22:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:22:59 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:04 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:14 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:19 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:24 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-changed-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG nova.compute.manager [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Refreshing instance network info cache due to event network-changed-cfe0247e-840a-4599-a280-dabc36db725e. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Refreshing network info cache for port cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated VIF entry in instance network info cache for port cfe0247e-840a-4599-a280-dabc36db725e. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG nova.network.neutron [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:23:28 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG nova.objects.instance [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:23:29 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:30 user nova-compute[82850]: INFO nova.compute.manager [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Attaching volume fe97f152-352e-43d2-aa94-a9ca218f0d59 to /dev/vdb
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.utils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a203b-049d-411d-9c5e-0d7b76d61adc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d59ebd-b0e5-49f1-965d-6cd78f5c73fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a33f8b-90c2-4081-a9ce-93a595082095]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5dcf08-cc31-4036-a53b-407b23bfd7c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:23:30 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:23:30 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21d80f5-d23b-4819-89b1-235048200680]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG os_brick.utils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:23:30 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating existing volume attachment record: 47ffb337-6e82-467d-a149-8497b0d98774 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:23:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwgiUfBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:23:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:23:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:23:34 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efc94f6-c64f-4249-bce2-5ac484322782]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:23:34 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d373528b-5199-41a9-9892-5f3e89993a34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59] added
Apr 12 08:23:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8fde8d-6298-4090-a66c-2e00fbaab2e3]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a75f15-46c2-4aa8-b514-89657f4266f2]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwgiUfBX {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwgiUfBX" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73819d18-3568-4e0b-851e-cd230f6a1609]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwgiUfBX'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09694250-d017-44c2-95fa-212921bf3a17]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bada5d4-1128-48ac-9dce-54cfa4708aa6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:23:34 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:23:34 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:23:34 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:23:34 user nova-compute[82850]: 
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee68aeb-cfdf-4b32-b3cd-1d41f81143d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260]
Apr 12 08:23:34 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260] successful.
Apr 12 08:23:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955fee9-6462-4d07-9879-66a607d5fc65]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032d0ab-62c5-4764-8d6e-7dcb962d0ea8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)
Apr 12 08:23:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)
Apr 12 08:23:34 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b6bb8-037a-4c9a-8b1a-dbbf24894809]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:23:34 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwgiUfBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26133646363666337', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133646363666337', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG nova.objects.instance [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:23:35 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 08:23:35 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:23:35 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:23:35 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:23:35 user nova-compute[82850]:   <serial>fe97f152-352e-43d2-aa94-a9ca218f0d59</serial>
Apr 12 08:23:35 user nova-compute[82850]: </disk>
Apr 12 08:23:35 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:7c:24:54, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.176s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:23:39 user nova-compute[82850]: INFO nova.compute.claims [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Claim successful on node user
Apr 12 08:23:39 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:23:39 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.policy [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:23:39 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Creating image(s)
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "/opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:39 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.135s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk 1073741824" returned: 0 in 0.051s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Cannot resize image /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.objects.instance [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'migration_context' on Instance uuid faec6a92-b2ab-44c3-a045-2c36968bc0a6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Successfully created port: 3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Ensure instance console log exists: /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:40 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Successfully updated port: 3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquired lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-changed-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Refreshing instance network info cache due to event network-changed-3c8d20da-03b3-4b1e-93c5-341ee3072412. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Acquiring lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updating instance_info_cache with network_info: [{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Releasing lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Instance network_info: |[{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Acquired lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Refreshing network info cache for port 3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Start _get_guest_xml network_info=[{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:23:41 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:23:41 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-910312600',display_name='tempest-AttachVolumeNegativeTest-server-910312600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-910312600',id=45,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM9pCxMTupPC8FymhImlOExM/HKRPk9qsagDYN99/JZgzMwIXtfBgODpc4SRm1PWt/D7jiPoW0tGkXQQXpqC9+GF5bK7HDN/yYNePSjb82841cYQFaIblr5fyolkxL03A==',key_name='tempest-keypair-716215007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-vmrwduyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:23:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=faec6a92-b2ab-44c3-a045-2c36968bc0a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.objects.instance [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'pci_devices' on Instance uuid faec6a92-b2ab-44c3-a045-2c36968bc0a6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:23:41 user nova-compute[82850]:   <uuid>faec6a92-b2ab-44c3-a045-2c36968bc0a6</uuid>
Apr 12 08:23:41 user nova-compute[82850]:   <name>instance-0000002d</name>
Apr 12 08:23:41 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:23:41 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:23:41 user nova-compute[82850]:   <metadata>
Apr 12 08:23:41 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:23:41 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-910312600</nova:name>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:23:41</nova:creationTime>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:23:41 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:23:41 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:owner>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:user uuid="bc8316aee1bb41ef99be6777924a33d8">tempest-AttachVolumeNegativeTest-1980986093-project-member</nova:user>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:project uuid="a47cb4fc9e2640399e7df51f12de123d">tempest-AttachVolumeNegativeTest-1980986093</nova:project>
Apr 12 08:23:41 user nova-compute[82850]:       </nova:owner>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:23:41 user nova-compute[82850]:       <nova:ports>
Apr 12 08:23:41 user nova-compute[82850]:         <nova:port uuid="3c8d20da-03b3-4b1e-93c5-341ee3072412">
Apr 12 08:23:41 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 08:23:41 user nova-compute[82850]:         </nova:port>
Apr 12 08:23:41 user nova-compute[82850]:       </nova:ports>
Apr 12 08:23:41 user nova-compute[82850]:     </nova:instance>
Apr 12 08:23:41 user nova-compute[82850]:   </metadata>
Apr 12 08:23:41 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:23:41 user nova-compute[82850]:     <system>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="serial">faec6a92-b2ab-44c3-a045-2c36968bc0a6</entry>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="uuid">faec6a92-b2ab-44c3-a045-2c36968bc0a6</entry>
Apr 12 08:23:41 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:23:41 user nova-compute[82850]:     </system>
Apr 12 08:23:41 user nova-compute[82850]:   </sysinfo>
Apr 12 08:23:41 user nova-compute[82850]:   <os>
Apr 12 08:23:41 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:23:41 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:23:41 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:23:41 user nova-compute[82850]:   </os>
Apr 12 08:23:41 user nova-compute[82850]:   <features>
Apr 12 08:23:41 user nova-compute[82850]:     <acpi/>
Apr 12 08:23:41 user nova-compute[82850]:     <apic/>
Apr 12 08:23:41 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:23:41 user nova-compute[82850]:   </features>
Apr 12 08:23:41 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:23:41 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:23:41 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:23:41 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:23:41 user nova-compute[82850]:   </clock>
Apr 12 08:23:41 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:23:41 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:23:41 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:23:41 user nova-compute[82850]:   </cpu>
Apr 12 08:23:41 user nova-compute[82850]:   <devices>
Apr 12 08:23:41 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:23:41 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:23:41 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk"/>
Apr 12 08:23:41 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:23:41 user nova-compute[82850]:     </disk>
Apr 12 08:23:41 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:23:41 user nova-compute[82850]:       <mac address="fa:16:3e:6a:3d:a6"/>
Apr 12 08:23:41 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:23:41 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:23:41 user nova-compute[82850]:       <target dev="tap3c8d20da-03"/>
Apr 12 08:23:41 user nova-compute[82850]:     </interface>
Apr 12 08:23:41 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:23:41 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/console.log" append="off"/>
Apr 12 08:23:41 user nova-compute[82850]:     </serial>
Apr 12 08:23:41 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:23:41 user nova-compute[82850]:     <video>
Apr 12 08:23:41 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:23:41 user nova-compute[82850]:     </video>
Apr 12 08:23:41 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:23:41 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:23:41 user nova-compute[82850]:     </rng>
Apr 12 08:23:41 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:23:41 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:23:41 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:23:41 user nova-compute[82850]:     </memballoon>
Apr 12 08:23:41 user nova-compute[82850]:   </devices>
Apr 12 08:23:41 user nova-compute[82850]: </domain>
Apr 12 08:23:41 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-910312600',display_name='tempest-AttachVolumeNegativeTest-server-910312600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-910312600',id=45,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM9pCxMTupPC8FymhImlOExM/HKRPk9qsagDYN99/JZgzMwIXtfBgODpc4SRm1PWt/D7jiPoW0tGkXQQXpqC9+GF5bK7HDN/yYNePSjb82841cYQFaIblr5fyolkxL03A==',key_name='tempest-keypair-716215007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-vmrwduyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:23:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=faec6a92-b2ab-44c3-a045-2c36968bc0a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG os_vif [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c8d20da-03, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c8d20da-03, col_values=(('external_ids', {'iface-id': '3c8d20da-03b3-4b1e-93c5-341ee3072412', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:3d:a6', 'vm-uuid': 'faec6a92-b2ab-44c3-a045-2c36968bc0a6'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:41 user nova-compute[82850]: INFO os_vif [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03')
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:6a:3d:a6, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updated VIF entry in instance network info cache for port 3c8d20da-03b3-4b1e-93c5-341ee3072412. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:23:41 user nova-compute[82850]: DEBUG nova.network.neutron [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updating instance_info_cache with network_info: [{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:23:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Releasing lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:23:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:23:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] No waiting events found dispatching network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:23:43 user nova-compute[82850]: WARNING nova.compute.manager [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received unexpected event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance with vm_state building and task_state spawning.
Apr 12 08:23:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287825.065237, faec6a92-b2ab-44c3-a045-2c36968bc0a6 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] VM Resumed (Lifecycle Event)
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Instance spawned successfully.
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681287825.067582, faec6a92-b2ab-44c3-a045-2c36968bc0a6 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] VM Started (Lifecycle Event)
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:45 user nova-compute[82850]: DEBUG nova.compute.manager [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] No waiting events found dispatching network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:23:45 user nova-compute[82850]: WARNING nova.compute.manager [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received unexpected event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance with vm_state building and task_state spawning.
Apr 12 08:23:45 user nova-compute[82850]: INFO nova.compute.manager [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Took 5.89 seconds to build instance.
Apr 12 08:23:45 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.992s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:46 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:23:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:23:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:23:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=26.02932357788086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:23:50 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:23:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:23:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:23:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:23:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:23:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:23:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:23:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:23:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:23:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:23:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:23:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:23:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:24:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:24:48 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:48 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:24:49 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:24:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:24:50 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=26.00910186767578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:24:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:24:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:24:54 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:24:55 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updating instance_info_cache with network_info: [{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:24:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:24:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:24:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:24:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:24:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:25:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:25:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-changed-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG nova.compute.manager [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Refreshing instance network info cache due to event network-changed-3c8d20da-03b3-4b1e-93c5-341ee3072412. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Acquiring lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Acquired lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG nova.network.neutron [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Refreshing network info cache for port 3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:30 user nova-compute[82850]: INFO nova.compute.manager [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Terminating instance
Apr 12 08:25:30 user nova-compute[82850]: DEBUG nova.compute.manager [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:30 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.network.neutron [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updated VIF entry in instance network info cache for port 3c8d20da-03b3-4b1e-93c5-341ee3072412. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.network.neutron [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updating instance_info_cache with network_info: [{"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Releasing lock "refresh_cache-faec6a92-b2ab-44c3-a045-2c36968bc0a6" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Instance destroyed successfully.
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.objects.instance [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'resources' on Instance uuid faec6a92-b2ab-44c3-a045-2c36968bc0a6 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:23:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-910312600',display_name='tempest-AttachVolumeNegativeTest-server-910312600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-910312600',id=45,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM9pCxMTupPC8FymhImlOExM/HKRPk9qsagDYN99/JZgzMwIXtfBgODpc4SRm1PWt/D7jiPoW0tGkXQQXpqC9+GF5bK7HDN/yYNePSjb82841cYQFaIblr5fyolkxL03A==',key_name='tempest-keypair-716215007',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-vmrwduyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=faec6a92-b2ab-44c3-a045-2c36968bc0a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "address": "fa:16:3e:6a:3d:a6", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8d20da-03", "ovs_interfaceid": "3c8d20da-03b3-4b1e-93c5-341ee3072412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG os_vif [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c8d20da-03, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:31 user nova-compute[82850]: INFO os_vif [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3c8d20da-03b3-4b1e-93c5-341ee3072412,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8d20da-03')
Apr 12 08:25:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Deleting instance files /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6_del
Apr 12 08:25:31 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Deletion of /opt/stack/data/nova/instances/faec6a92-b2ab-44c3-a045-2c36968bc0a6_del complete
Apr 12 08:25:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:31 user nova-compute[82850]: INFO nova.compute.manager [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 12 08:25:31 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:25:31 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:25:32 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Took 1.02 seconds to deallocate network for instance.
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-deleted-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-unplugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] No waiting events found dispatching network-vif-unplugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-unplugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Acquiring lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] No waiting events found dispatching network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:25:32 user nova-compute[82850]: WARNING nova.compute.manager [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Received unexpected event network-vif-plugged-3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance with vm_state active and task_state deleting.
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:32 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Deleted allocations for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6
Apr 12 08:25:32 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "faec6a92-b2ab-44c3-a045-2c36968bc0a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:46 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681287931.4639187, faec6a92-b2ab-44c3-a045-2c36968bc0a6 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:25:46 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] VM Stopped (Lifecycle Event)
Apr 12 08:25:46 user nova-compute[82850]: DEBUG nova.compute.manager [None req-7f9c88e8-fe8c-4245-8b45-703e7a67ef66 None None] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:25:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:25:50 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82850) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 08:25:51 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:25:51 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=26.027996063232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:25:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:25:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:25:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:25:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:25:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:26:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:11 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:11 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:26:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:18 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:21 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:26:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:26:22 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:26:22 user nova-compute[82850]: INFO nova.compute.manager [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Detaching volume fe97f152-352e-43d2-aa94-a9ca218f0d59
Apr 12 08:26:22 user nova-compute[82850]: INFO nova.virt.block_device [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Attempting to driver detach volume fe97f152-352e-43d2-aa94-a9ca218f0d59 from mountpoint /dev/vdb
Apr 12 08:26:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Attempting to detach device vdb from instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:26:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:26:22 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:26:22 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:26:22 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:26:22 user nova-compute[82850]:   <serial>fe97f152-352e-43d2-aa94-a9ca218f0d59</serial>
Apr 12 08:26:22 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:26:22 user nova-compute[82850]: </disk>
Apr 12 08:26:22 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:26:22 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 from the persistent domain config.
Apr 12 08:26:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:26:22 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:26:22 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:26:22 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:26:22 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:26:22 user nova-compute[82850]:   <serial>fe97f152-352e-43d2-aa94-a9ca218f0d59</serial>
Apr 12 08:26:22 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:26:22 user nova-compute[82850]: </disk>
Apr 12 08:26:22 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681287983.102278, 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:26:23 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 from the live domain config.
Apr 12 08:26:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwgiUfBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:26:23 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b323a-6ca3-4da6-bad1-de4c42c6666e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:26:23 user nova-compute[82850]: No targets found.
Apr 12 08:26:23 user nova-compute[82850]: iSNS:
Apr 12 08:26:23 user nova-compute[82850]: No targets found.
Apr 12 08:26:23 user nova-compute[82850]: STATIC:
Apr 12 08:26:23 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59
Apr 12 08:26:23 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:26:23 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:26:23 user nova-compute[82850]: FIRMWARE:
Apr 12 08:26:23 user nova-compute[82850]: No targets found.
Apr 12 08:26:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:26:23 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:26:23 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf00d5-3f3b-4652-a00c-590472e36164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a78635-3948-4bf6-8780-1903b4d2a515]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)
Apr 12 08:26:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 (non-flash)
Apr 12 08:26:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c0ae3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ccff3-a695-460e-8230-ec6cd178b079]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[88edb4c6-f1a5-4801-8267-44ddee613d3a]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0566f5d2-09eb-4f30-a437-21423c15215e]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a2c0cc-8e65-4298-954a-d25e9efdcab8]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7db4f-84ae-4766-8160-f37ba7e4b535]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a544168-94ba-4800-a1c7-141afafb0348]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260]
Apr 12 08:26:23 user nova-compute[82850]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59, portal: 172.16.0.220,3260] successful.
Apr 12 08:26:23 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe97f152-352e-43d2-aa94-a9ca218f0d59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44260002-b09d-43e8-85d6-e0d72fadf38f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== disconnect_volume: return (284ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:26:23 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:26:24 user nova-compute[82850]: DEBUG nova.objects.instance [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:26:24 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:26:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:27 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:26:51 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:26:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:26:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=26.02722930908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:26:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:26:56 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:26:57 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [{"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:26:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-3d081049-b4cf-4ae7-b1ee-9961c9b900c0" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:26:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:26:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:02 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:02 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Triggering sync for uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 08:27:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:02 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:12 user nova-compute[82850]: INFO nova.compute.manager [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Terminating instance
Apr 12 08:27:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:27:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-unplugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] No waiting events found dispatching network-vif-unplugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.compute.manager [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-unplugged-cfe0247e-840a-4599-a280-dabc36db725e for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Instance destroyed successfully.
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.objects.instance [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'resources' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-285957137',display_name='tempest-AttachVolumeNegativeTest-server-285957137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-285957137',id=44,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm1iDAsrc5nn5HZ4c1S2/5BQYY9OlMCCqludw0R7nIsR4rOX1g1NGeT0qKEvePSLaBIvNw+MxhrHLfdqFpCA8NgOH4lVOQi4JLS7OyBU4zU694ItIO3yoJ/KXTGUqpZ2w==',key_name='tempest-keypair-177521254',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-fbs891w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=3d081049-b4cf-4ae7-b1ee-9961c9b900c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "cfe0247e-840a-4599-a280-dabc36db725e", "address": "fa:16:3e:7c:24:54", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe0247e-84", "ovs_interfaceid": "cfe0247e-840a-4599-a280-dabc36db725e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG os_vif [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfe0247e-84, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:27:13 user nova-compute[82850]: INFO os_vif [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:24:54,bridge_name='br-int',has_traffic_filtering=True,id=cfe0247e-840a-4599-a280-dabc36db725e,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe0247e-84')
Apr 12 08:27:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Deleting instance files /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0_del
Apr 12 08:27:13 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Deletion of /opt/stack/data/nova/instances/3d081049-b4cf-4ae7-b1ee-9961c9b900c0_del complete
Apr 12 08:27:13 user nova-compute[82850]: INFO nova.compute.manager [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 12 08:27:13 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:27:13 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:27:14 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:27:14 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Took 0.70 seconds to deallocate network for instance.
Apr 12 08:27:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:14 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:27:14 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:27:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:14 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Deleted allocations for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0
Apr 12 08:27:14 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:27:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Acquiring lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:15 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Lock "3d081049-b4cf-4ae7-b1ee-9961c9b900c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] No waiting events found dispatching network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:27:15 user nova-compute[82850]: WARNING nova.compute.manager [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received unexpected event network-vif-plugged-cfe0247e-840a-4599-a280-dabc36db725e for instance with vm_state deleted and task_state None.
Apr 12 08:27:15 user nova-compute[82850]: DEBUG nova.compute.manager [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Received event network-vif-deleted-cfe0247e-840a-4599-a280-dabc36db725e {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:27:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:28 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681288033.659948, 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:27:28 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] VM Stopped (Lifecycle Event)
Apr 12 08:27:28 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9b0d5b30-ce0b-41fc-8e17-b009bd21fbc3 None None] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:27:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:52 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:27:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:27:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=26.04629898071289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:27:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:27:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:27:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:27:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:27:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:27:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:27:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:28:06 user nova-compute[82850]: INFO nova.compute.claims [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Claim successful on node user
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:28:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.policy [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:28:06 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Creating image(s)
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:06 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.134s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk 1073741824" returned: 0 in 0.050s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Successfully created port: b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Cannot resize image /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.objects.instance [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'migration_context' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Ensure instance console log exists: /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Successfully updated port: b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquired lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-changed-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.compute.manager [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Refreshing instance network info cache due to event network-changed-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Acquiring lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Releasing lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Instance network_info: |[{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Acquired lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Refreshing network info cache for port b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Start _get_guest_xml network_info=[{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:28:08 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:28:08 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923555869',display_name='tempest-AttachVolumeNegativeTest-server-923555869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923555869',id=46,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGyZA1ZeqVr3kIkQerkrIxkBYEtaj+f/lnAVisTbMszSIHQ+N6ZlNufmNpj4S0WRt4ACMMPuRWTvUI079G3ER1Cz3BVugopH8sZ5SemmiLBdNoG1JS8/iMoV6plZmP1kw==',key_name='tempest-keypair-105244774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-ni20x6y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=7a45ae66-bd9d-46f9-901c-fb2e471a25ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:28:08 user nova-compute[82850]:   <uuid>7a45ae66-bd9d-46f9-901c-fb2e471a25ae</uuid>
Apr 12 08:28:08 user nova-compute[82850]:   <name>instance-0000002e</name>
Apr 12 08:28:08 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:28:08 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:28:08 user nova-compute[82850]:   <metadata>
Apr 12 08:28:08 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:28:08 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-923555869</nova:name>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:28:08</nova:creationTime>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:28:08 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:28:08 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:owner>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:user uuid="bc8316aee1bb41ef99be6777924a33d8">tempest-AttachVolumeNegativeTest-1980986093-project-member</nova:user>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:project uuid="a47cb4fc9e2640399e7df51f12de123d">tempest-AttachVolumeNegativeTest-1980986093</nova:project>
Apr 12 08:28:08 user nova-compute[82850]:       </nova:owner>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:28:08 user nova-compute[82850]:       <nova:ports>
Apr 12 08:28:08 user nova-compute[82850]:         <nova:port uuid="b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd">
Apr 12 08:28:08 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 08:28:08 user nova-compute[82850]:         </nova:port>
Apr 12 08:28:08 user nova-compute[82850]:       </nova:ports>
Apr 12 08:28:08 user nova-compute[82850]:     </nova:instance>
Apr 12 08:28:08 user nova-compute[82850]:   </metadata>
Apr 12 08:28:08 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:28:08 user nova-compute[82850]:     <system>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="serial">7a45ae66-bd9d-46f9-901c-fb2e471a25ae</entry>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="uuid">7a45ae66-bd9d-46f9-901c-fb2e471a25ae</entry>
Apr 12 08:28:08 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:28:08 user nova-compute[82850]:     </system>
Apr 12 08:28:08 user nova-compute[82850]:   </sysinfo>
Apr 12 08:28:08 user nova-compute[82850]:   <os>
Apr 12 08:28:08 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:28:08 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:28:08 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:28:08 user nova-compute[82850]:   </os>
Apr 12 08:28:08 user nova-compute[82850]:   <features>
Apr 12 08:28:08 user nova-compute[82850]:     <acpi/>
Apr 12 08:28:08 user nova-compute[82850]:     <apic/>
Apr 12 08:28:08 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:28:08 user nova-compute[82850]:   </features>
Apr 12 08:28:08 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:28:08 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:28:08 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:28:08 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:28:08 user nova-compute[82850]:   </clock>
Apr 12 08:28:08 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:28:08 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:28:08 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:28:08 user nova-compute[82850]:   </cpu>
Apr 12 08:28:08 user nova-compute[82850]:   <devices>
Apr 12 08:28:08 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:28:08 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:28:08 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk"/>
Apr 12 08:28:08 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:28:08 user nova-compute[82850]:     </disk>
Apr 12 08:28:08 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:28:08 user nova-compute[82850]:       <mac address="fa:16:3e:cb:3c:10"/>
Apr 12 08:28:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:28:08 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:28:08 user nova-compute[82850]:       <target dev="tapb8fb9391-b6"/>
Apr 12 08:28:08 user nova-compute[82850]:     </interface>
Apr 12 08:28:08 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:28:08 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/console.log" append="off"/>
Apr 12 08:28:08 user nova-compute[82850]:     </serial>
Apr 12 08:28:08 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:28:08 user nova-compute[82850]:     <video>
Apr 12 08:28:08 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:28:08 user nova-compute[82850]:     </video>
Apr 12 08:28:08 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:28:08 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:28:08 user nova-compute[82850]:     </rng>
Apr 12 08:28:08 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:28:08 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:28:08 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:28:08 user nova-compute[82850]:     </memballoon>
Apr 12 08:28:08 user nova-compute[82850]:   </devices>
Apr 12 08:28:08 user nova-compute[82850]: </domain>
Apr 12 08:28:08 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923555869',display_name='tempest-AttachVolumeNegativeTest-server-923555869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923555869',id=46,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGyZA1ZeqVr3kIkQerkrIxkBYEtaj+f/lnAVisTbMszSIHQ+N6ZlNufmNpj4S0WRt4ACMMPuRWTvUI079G3ER1Cz3BVugopH8sZ5SemmiLBdNoG1JS8/iMoV6plZmP1kw==',key_name='tempest-keypair-105244774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-ni20x6y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=7a45ae66-bd9d-46f9-901c-fb2e471a25ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG os_vif [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8fb9391-b6, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8fb9391-b6, col_values=(('external_ids', {'iface-id': 'b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:3c:10', 'vm-uuid': '7a45ae66-bd9d-46f9-901c-fb2e471a25ae'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:08 user nova-compute[82850]: INFO os_vif [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6')
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:cb:3c:10, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updated VIF entry in instance network info cache for port b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG nova.network.neutron [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:28:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Releasing lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:28:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:09 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG nova.compute.manager [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] No waiting events found dispatching network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:28:10 user nova-compute[82850]: WARNING nova.compute.manager [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received unexpected event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance with vm_state building and task_state spawning.
Apr 12 08:28:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:10 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681288092.1055286, 7a45ae66-bd9d-46f9-901c-fb2e471a25ae => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] VM Resumed (Lifecycle Event)
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Instance spawned successfully.
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681288092.107364, 7a45ae66-bd9d-46f9-901c-fb2e471a25ae => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] VM Started (Lifecycle Event)
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Took 5.28 seconds to spawn the instance on the hypervisor.
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:28:12 user nova-compute[82850]: INFO nova.compute.manager [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Took 5.77 seconds to build instance.
Apr 12 08:28:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.867s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:12 user nova-compute[82850]: DEBUG nova.compute.manager [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] No waiting events found dispatching network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:28:12 user nova-compute[82850]: WARNING nova.compute.manager [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received unexpected event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance with vm_state active and task_state None.
Apr 12 08:28:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:28:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:22 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:53 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:28:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:28:54 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=26.024715423583984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:28:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:28:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:28:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:28:58 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:28:59 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:28:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:28:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:29:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:29:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:29:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:29:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:29:54 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:29:55 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:29:55 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=26.024139404296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:29:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:29:56 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:56 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-changed-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Refreshing instance network info cache due to event network-changed-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Acquiring lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Acquired lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Refreshing network info cache for port b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updated VIF entry in instance network info cache for port b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG nova.network.neutron [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:29:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Releasing lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:29:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:29:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:29:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:29:58 user nova-compute[82850]: DEBUG nova.objects.instance [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:29:59 user nova-compute[82850]: INFO nova.compute.manager [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Attaching volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 to /dev/vdb
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.utils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d36139-a7dc-48e1-99f5-db624909d92a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af0cc3-ba91-4ef3-82b6-9447bafd4ed2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[21515c53-8960-44fc-9334-0e5412b89ffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbe5f7-d190-45e7-b9ef-a375981cf68e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:29:59 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:29:59 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf64387-8e77-458c-afae-8706892265ba]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG os_brick.utils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:29:59 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating existing volume attachment record: 008f471c-b6c3-42a7-9f9b-df76526f6f54 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:30:00 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:30:01 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [{"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:30:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-7a45ae66-bd9d-46f9-901c-fb2e471a25ae" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:30:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:30:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:02 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjbNRSeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:30:04 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:30:04 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:30:04 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc741cd-250b-4485-b1d4-fb31f0f3e6b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:30:04 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd97e09-f8e0-4b59-a744-743d377cda79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066] added
Apr 12 08:30:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0603b142-7727-45a1-8011-22f79691aa9d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d4c0a-d189-457f-a93a-6c69b41a7b2c]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DjbNRSeX {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DjbNRSeX" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc926878-80fc-4b58-b715-9851fa99e638]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DjbNRSeX'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[285db2a8-f05b-49d1-b8fd-f6e47cabdd06]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e4487-fc03-48c4-a657-dea28b38dd02]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:30:04 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:30:04 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:30:04 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:30:04 user nova-compute[82850]: 
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a920e-0d06-4596-bda5-2adfe17fc29a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260]
Apr 12 08:30:04 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260] successful.
Apr 12 08:30:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec99b7f-2e0a-4249-86c8-eecc1c19c7b6]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef321a-e612-4591-9ffa-7fd7db120075]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)
Apr 12 08:30:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)
Apr 12 08:30:04 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:04 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:05 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d22ff-e792-4c1b-a0aa-b5817e323994]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:05 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:30:05 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjbNRSeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26130623835353565', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130623835353565', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.objects.instance [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 08:30:06 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:30:06 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:30:06 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:30:06 user nova-compute[82850]:   <serial>5f76f5a2-87dd-4fed-af77-e5f70f388066</serial>
Apr 12 08:30:06 user nova-compute[82850]: </disk>
Apr 12 08:30:06 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:cb:3c:10, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.443s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:06 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:07 user nova-compute[82850]: INFO nova.compute.manager [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Detaching volume 5f76f5a2-87dd-4fed-af77-e5f70f388066
Apr 12 08:30:07 user nova-compute[82850]: INFO nova.virt.block_device [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Attempting to driver detach volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 from mountpoint /dev/vdb
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Attempting to detach device vdb from instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:30:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:30:07 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:30:07 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:30:07 user nova-compute[82850]:   <serial>5f76f5a2-87dd-4fed-af77-e5f70f388066</serial>
Apr 12 08:30:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:30:07 user nova-compute[82850]: </disk>
Apr 12 08:30:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:30:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae from the persistent domain config.
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:30:07 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:30:07 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:30:07 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:30:07 user nova-compute[82850]:   <serial>5f76f5a2-87dd-4fed-af77-e5f70f388066</serial>
Apr 12 08:30:07 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:30:07 user nova-compute[82850]: </disk>
Apr 12 08:30:07 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681288207.7908053, 7a45ae66-bd9d-46f9-901c-fb2e471a25ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:30:07 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae from the live domain config.
Apr 12 08:30:07 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjbNRSeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:30:07 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[77658be0-0d32-4174-834b-b4123775dc68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:30:07 user nova-compute[82850]: No targets found.
Apr 12 08:30:07 user nova-compute[82850]: iSNS:
Apr 12 08:30:07 user nova-compute[82850]: No targets found.
Apr 12 08:30:07 user nova-compute[82850]: STATIC:
Apr 12 08:30:07 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066
Apr 12 08:30:07 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:30:07 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:30:07 user nova-compute[82850]: FIRMWARE:
Apr 12 08:30:07 user nova-compute[82850]: No targets found.
Apr 12 08:30:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:30:07 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:30:07 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7b6f4-4f33-43ec-a8fb-76dcf7b4e9aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f35da-da94-478f-83a1-5d8633138217]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)
Apr 12 08:30:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 (non-flash)
Apr 12 08:30:07 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f193424bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3951e5-d1a1-4a96-b895-7e3cb1c5b644]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdfd0e2-5a50-4a5a-87b8-0bbf77cce218]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44292f62-9f91-4cf1-bc4a-867e00070ca7]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e8d636-8e7a-4d29-807c-41830963aaa2]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:30:07 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc80fbe-e8a6-496f-b060-156376a2b7a4]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9431e0c6-f912-48b3-99ef-701b63fb58ef]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260]
Apr 12 08:30:08 user nova-compute[82850]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066, portal: 172.16.0.220,3260] successful.
Apr 12 08:30:08 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f76f5a2-87dd-4fed-af77-e5f70f388066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7329a8-a0b9-46e6-8f4d-007b8fc35f77]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== disconnect_volume: return (280ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG nova.objects.instance [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:30:08 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:30:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:26 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:31 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:36 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:30:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:30:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:30:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=26.023025512695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:30:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:57 user nova-compute[82850]: INFO nova.compute.manager [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Terminating instance
Apr 12 08:30:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-unplugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] No waiting events found dispatching network-vif-unplugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-unplugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:30:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Instance destroyed successfully.
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'resources' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923555869',display_name='tempest-AttachVolumeNegativeTest-server-923555869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923555869',id=46,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGyZA1ZeqVr3kIkQerkrIxkBYEtaj+f/lnAVisTbMszSIHQ+N6ZlNufmNpj4S0WRt4ACMMPuRWTvUI079G3ER1Cz3BVugopH8sZ5SemmiLBdNoG1JS8/iMoV6plZmP1kw==',key_name='tempest-keypair-105244774',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-ni20x6y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=7a45ae66-bd9d-46f9-901c-fb2e471a25ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "address": "fa:16:3e:cb:3c:10", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8fb9391-b6", "ovs_interfaceid": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG os_vif [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8fb9391-b6, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:30:58 user nova-compute[82850]: INFO os_vif [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:3c:10,bridge_name='br-int',has_traffic_filtering=True,id=b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8fb9391-b6')
Apr 12 08:30:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Deleting instance files /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae_del
Apr 12 08:30:58 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Deletion of /opt/stack/data/nova/instances/7a45ae66-bd9d-46f9-901c-fb2e471a25ae_del complete
Apr 12 08:30:58 user nova-compute[82850]: INFO nova.compute.manager [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:30:58 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:30:59 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:30:59 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Took 0.70 seconds to deallocate network for instance.
Apr 12 08:30:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:30:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:30:59 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:30:59 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:30:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:30:59 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Deleted allocations for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae
Apr 12 08:30:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Acquiring lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Lock "7a45ae66-bd9d-46f9-901c-fb2e471a25ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] No waiting events found dispatching network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:31:00 user nova-compute[82850]: WARNING nova.compute.manager [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received unexpected event network-vif-plugged-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance with vm_state deleted and task_state None.
Apr 12 08:31:00 user nova-compute[82850]: DEBUG nova.compute.manager [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Received event network-vif-deleted-b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:31:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:31:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:31:01 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:31:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681288258.3976989, 7a45ae66-bd9d-46f9-901c-fb2e471a25ae => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:31:13 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] VM Stopped (Lifecycle Event)
Apr 12 08:31:13 user nova-compute[82850]: DEBUG nova.compute.manager [None req-88f2015e-5205-4c82-8a36-b96c52db3f8c None None] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:31:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:15 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:15 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:31:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:31:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:41 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Starting instance... {{(pid=82850) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82850) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 08:31:51 user nova-compute[82850]: INFO nova.compute.claims [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Claim successful on node user
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Start building networks asynchronously for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Allocating IP information in the background. {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] allocate_for_instance() {{(pid=82850) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 08:31:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Start building block device mappings for instance. {{(pid=82850) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.policy [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82850) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Start spawning the instance on the hypervisor. {{(pid=82850) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Creating instance directory {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 08:31:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Creating image(s)
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "/opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "/opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "9c629b490f6d7574974a312e45ed199fccc05b81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.130s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk 1073741824 {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81,backing_fmt=raw /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk 1073741824" returned: 0 in 0.056s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "9c629b490f6d7574974a312e45ed199fccc05b81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c629b490f6d7574974a312e45ed199fccc05b81 --force-share --output=json" returned: 0 in 0.131s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk. size=1073741824 {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.virt.disk.api [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Cannot resize image /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk to a smaller size. {{(pid=82850) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'migration_context' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Created local disks {{(pid=82850) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Ensure instance console log exists: /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/console.log {{(pid=82850) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:52 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Successfully created port: ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Successfully updated port: ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Building network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-changed-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.compute.manager [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Refreshing instance network info cache due to event network-changed-ef876483-6e28-412d-812e-4dcc46a83e72. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Instance cache missing network info. {{(pid=82850) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Instance network_info: |[{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82850) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Refreshing network info cache for port ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Start _get_guest_xml network_info=[{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '68a0a523-85da-4c40-ac88-5d5f304c0b18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 08:31:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:31:53 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82850) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T07:36:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T07:35:33Z,direct_url=<?>,disk_format='qcow2',id=68a0a523-85da-4c40-ac88-5d5f304c0b18,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='b57523dc439f4bd8adaf36cb3610ca4d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T07:35:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Got 1 possible topologies {{(pid=82850) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82850) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363091089',display_name='tempest-AttachVolumeNegativeTest-server-1363091089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363091089',id=47,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHZCSN81t3Io3Y++NE4Gh0YasDUXE842ZBA6mOygVjGPbzO4CGVo8mbqa+gXO481QBrTnr6SFedIV8i+AuHemQ7wQMrEXDAgFVNa9s9LF3GPqX9JOFdDmQgrejfgLEvTg==',key_name='tempest-keypair-1879219279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-0bsbgf3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=83e1d52a-a5aa-47ac-85ef-ef85ca3afb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82850) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.objects.instance [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'pci_devices' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] End _get_guest_xml xml=<domain type="kvm">
Apr 12 08:31:53 user nova-compute[82850]:   <uuid>83e1d52a-a5aa-47ac-85ef-ef85ca3afb95</uuid>
Apr 12 08:31:53 user nova-compute[82850]:   <name>instance-0000002f</name>
Apr 12 08:31:53 user nova-compute[82850]:   <memory>131072</memory>
Apr 12 08:31:53 user nova-compute[82850]:   <vcpu>1</vcpu>
Apr 12 08:31:53 user nova-compute[82850]:   <metadata>
Apr 12 08:31:53 user nova-compute[82850]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 08:31:53 user nova-compute[82850]:       <nova:package version="0.0.0"/>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1363091089</nova:name>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:creationTime>2023-04-12 08:31:53</nova:creationTime>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:flavor name="m1.nano">
Apr 12 08:31:53 user nova-compute[82850]:         <nova:memory>128</nova:memory>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:disk>1</nova:disk>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:swap>0</nova:swap>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:vcpus>1</nova:vcpus>
Apr 12 08:31:53 user nova-compute[82850]:       </nova:flavor>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:owner>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:user uuid="bc8316aee1bb41ef99be6777924a33d8">tempest-AttachVolumeNegativeTest-1980986093-project-member</nova:user>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:project uuid="a47cb4fc9e2640399e7df51f12de123d">tempest-AttachVolumeNegativeTest-1980986093</nova:project>
Apr 12 08:31:53 user nova-compute[82850]:       </nova:owner>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:root type="image" uuid="68a0a523-85da-4c40-ac88-5d5f304c0b18"/>
Apr 12 08:31:53 user nova-compute[82850]:       <nova:ports>
Apr 12 08:31:53 user nova-compute[82850]:         <nova:port uuid="ef876483-6e28-412d-812e-4dcc46a83e72">
Apr 12 08:31:53 user nova-compute[82850]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 08:31:53 user nova-compute[82850]:         </nova:port>
Apr 12 08:31:53 user nova-compute[82850]:       </nova:ports>
Apr 12 08:31:53 user nova-compute[82850]:     </nova:instance>
Apr 12 08:31:53 user nova-compute[82850]:   </metadata>
Apr 12 08:31:53 user nova-compute[82850]:   <sysinfo type="smbios">
Apr 12 08:31:53 user nova-compute[82850]:     <system>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="product">OpenStack Nova</entry>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="version">0.0.0</entry>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="serial">83e1d52a-a5aa-47ac-85ef-ef85ca3afb95</entry>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="uuid">83e1d52a-a5aa-47ac-85ef-ef85ca3afb95</entry>
Apr 12 08:31:53 user nova-compute[82850]:       <entry name="family">Virtual Machine</entry>
Apr 12 08:31:53 user nova-compute[82850]:     </system>
Apr 12 08:31:53 user nova-compute[82850]:   </sysinfo>
Apr 12 08:31:53 user nova-compute[82850]:   <os>
Apr 12 08:31:53 user nova-compute[82850]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 08:31:53 user nova-compute[82850]:     <boot dev="hd"/>
Apr 12 08:31:53 user nova-compute[82850]:     <smbios mode="sysinfo"/>
Apr 12 08:31:53 user nova-compute[82850]:   </os>
Apr 12 08:31:53 user nova-compute[82850]:   <features>
Apr 12 08:31:53 user nova-compute[82850]:     <acpi/>
Apr 12 08:31:53 user nova-compute[82850]:     <apic/>
Apr 12 08:31:53 user nova-compute[82850]:     <vmcoreinfo/>
Apr 12 08:31:53 user nova-compute[82850]:   </features>
Apr 12 08:31:53 user nova-compute[82850]:   <clock offset="utc">
Apr 12 08:31:53 user nova-compute[82850]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 08:31:53 user nova-compute[82850]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 08:31:53 user nova-compute[82850]:     <timer name="hpet" present="no"/>
Apr 12 08:31:53 user nova-compute[82850]:   </clock>
Apr 12 08:31:53 user nova-compute[82850]:   <cpu mode="custom" match="exact">
Apr 12 08:31:53 user nova-compute[82850]:     <model>Nehalem</model>
Apr 12 08:31:53 user nova-compute[82850]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 08:31:53 user nova-compute[82850]:   </cpu>
Apr 12 08:31:53 user nova-compute[82850]:   <devices>
Apr 12 08:31:53 user nova-compute[82850]:     <disk type="file" device="disk">
Apr 12 08:31:53 user nova-compute[82850]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 08:31:53 user nova-compute[82850]:       <source file="/opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk"/>
Apr 12 08:31:53 user nova-compute[82850]:       <target dev="vda" bus="virtio"/>
Apr 12 08:31:53 user nova-compute[82850]:     </disk>
Apr 12 08:31:53 user nova-compute[82850]:     <interface type="ethernet">
Apr 12 08:31:53 user nova-compute[82850]:       <mac address="fa:16:3e:68:74:16"/>
Apr 12 08:31:53 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:31:53 user nova-compute[82850]:       <mtu size="1442"/>
Apr 12 08:31:53 user nova-compute[82850]:       <target dev="tapef876483-6e"/>
Apr 12 08:31:53 user nova-compute[82850]:     </interface>
Apr 12 08:31:53 user nova-compute[82850]:     <serial type="pty">
Apr 12 08:31:53 user nova-compute[82850]:       <log file="/opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/console.log" append="off"/>
Apr 12 08:31:53 user nova-compute[82850]:     </serial>
Apr 12 08:31:53 user nova-compute[82850]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 08:31:53 user nova-compute[82850]:     <video>
Apr 12 08:31:53 user nova-compute[82850]:       <model type="virtio"/>
Apr 12 08:31:53 user nova-compute[82850]:     </video>
Apr 12 08:31:53 user nova-compute[82850]:     <rng model="virtio">
Apr 12 08:31:53 user nova-compute[82850]:       <backend model="random">/dev/urandom</backend>
Apr 12 08:31:53 user nova-compute[82850]:     </rng>
Apr 12 08:31:53 user nova-compute[82850]:     <controller type="usb" index="0" model="none"/>
Apr 12 08:31:53 user nova-compute[82850]:     <memballoon model="virtio">
Apr 12 08:31:53 user nova-compute[82850]:       <stats period="10"/>
Apr 12 08:31:53 user nova-compute[82850]:     </memballoon>
Apr 12 08:31:53 user nova-compute[82850]:   </devices>
Apr 12 08:31:53 user nova-compute[82850]: </domain>
Apr 12 08:31:53 user nova-compute[82850]:  {{(pid=82850) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363091089',display_name='tempest-AttachVolumeNegativeTest-server-1363091089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363091089',id=47,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHZCSN81t3Io3Y++NE4Gh0YasDUXE842ZBA6mOygVjGPbzO4CGVo8mbqa+gXO481QBrTnr6SFedIV8i+AuHemQ7wQMrEXDAgFVNa9s9LF3GPqX9JOFdDmQgrejfgLEvTg==',key_name='tempest-keypair-1879219279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-0bsbgf3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T08:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=83e1d52a-a5aa-47ac-85ef-ef85ca3afb95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG os_vif [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e') {{(pid=82850) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef876483-6e, may_exist=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef876483-6e, col_values=(('external_ids', {'iface-id': 'ef876483-6e28-412d-812e-4dcc46a83e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:74:16', 'vm-uuid': '83e1d52a-a5aa-47ac-85ef-ef85ca3afb95'}),)) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:53 user nova-compute[82850]: INFO os_vif [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e')
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:68:74:16, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updated VIF entry in instance network info cache for port ef876483-6e28-412d-812e-4dcc46a83e72. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG nova.network.neutron [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:31:53 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:31:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:54 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG nova.compute.manager [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] No waiting events found dispatching network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:31:55 user nova-compute[82850]: WARNING nova.compute.manager [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received unexpected event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 for instance with vm_state building and task_state spawning.
Apr 12 08:31:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:55 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:31:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:31:56 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=26.041099548339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:31:56 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681288317.0911837, 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => Resumed> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] VM Resumed (Lifecycle Event)
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Instance event wait completed in 0 seconds for  {{(pid=82850) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Guest created on hypervisor {{(pid=82850) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Instance spawned successfully.
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_cdrom_bus of ide {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_disk_bus of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_input_bus of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_pointer_model of None {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_video_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Found default for hw_vif_model of virtio {{(pid=82850) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.virt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Emitting event <LifecycleEvent: 1681288317.092293, 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => Started> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] VM Started (Lifecycle Event)
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82850) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:57 user nova-compute[82850]: DEBUG nova.compute.manager [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] No waiting events found dispatching network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:31:57 user nova-compute[82850]: WARNING nova.compute.manager [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received unexpected event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 for instance with vm_state building and task_state spawning.
Apr 12 08:31:57 user nova-compute[82850]: INFO nova.compute.manager [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Took 5.94 seconds to build instance.
Apr 12 08:31:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.055s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:31:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:31:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:31:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:01 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:32:03 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:26 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:55 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:55 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:32:57 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:32:58 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:32:58 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=26.020553588867188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:32:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:32:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:02 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:33:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:33:05 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:33:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:33:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:33:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-changed-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG nova.compute.manager [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Refreshing instance network info cache due to event network-changed-ef876483-6e28-412d-812e-4dcc46a83e72. {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Refreshing network info cache for port ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updated VIF entry in instance network info cache for port ef876483-6e28-412d-812e-4dcc46a83e72. {{(pid=82850) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG nova.network.neutron [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:33:42 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:33:43 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG nova.objects.instance [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:33:44 user nova-compute[82850]: INFO nova.compute.manager [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Attaching volume fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb to /dev/vdb
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.utils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a1eb0-90f2-4041-8e61-6d604cb350c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f18a5e5eefdf\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec5b3f-3c54-4c09-b9d2-a452d27b5087]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92545352-791e-4f56-8875-8643c4a9f512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08a675-73bd-4fbe-ae03-94ea5ea8b75c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Running cmd (subprocess): nvme version {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 'nvme version' failed. Not Retrying. {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] nvme not present on system {{(pid=82850) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 08:33:44 user nova-compute[82850]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 08:33:44 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a645e-7e0f-4433-a462-6aad6f7e3816]: (4, '') {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82850) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.lightos [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] LIGHTOS: no hostnqn found. {{(pid=82850) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG os_brick.utils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f18a5e5eefdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:33:44 user nova-compute[82850]: DEBUG nova.virt.block_device [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating existing volume attachment record: c83c2df7-131e-46b7-9dd2-70fcedf34737 {{(pid=82850) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 08:33:46 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Calling os-brick to attach iSCSI Volume {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdebuJrs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:33:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:33:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:33:48 user nova-compute[82850]: INFO os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90401df-8d67-40be-9582-edcabec2ad33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 08:33:48 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --interface default --op new {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fed918-25ef-49ee-b342-5ad9e6195a92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb] added\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb] added
Apr 12 08:33:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80b882-ae3e-4777-bd0a-df7cf032b93f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8dd95-2e26-4d7e-b2dc-58f10fb2067d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdebuJrs {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdebuJrs" returned: 0 in 0.056s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb9f87-6c9d-410d-809f-54677a79864f]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HdebuJrs'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e629d-eff5-4c73-9774-37b2e3cc706d]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa6ccb-9e6b-4a57-b74e-b4aee6e0f870]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:33:48 user nova-compute[82850]:  {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 08:33:48 user nova-compute[82850]:  {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:33:48 user nova-compute[82850]: WARNING os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 08:33:48 user nova-compute[82850]: 
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --login {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfdb483-8f9b-46a6-874a-6f74bdf47012]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260]
Apr 12 08:33:48 user nova-compute[82850]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260] successful.
Apr 12 08:33:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8efbe-725f-43ca-aad6-b6de736b1b62]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b4bc8-b723-4493-8510-37e5ead927b9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)
Apr 12 08:33:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)
Apr 12 08:33:48 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to 172.16.0.220:3260 {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=82850) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82850) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed7ee7-67ae-4382-b044-a9abde549540]: (4, ('- - 0', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82850) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 08:33:48 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdebuJrs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82850) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 08:33:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:33:49 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23834313563616162', 'path': '/dev/sdb'} {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:33:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834313563616162', 'path': '/dev/sdb'} {{(pid=82850) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 08:33:49 user nova-compute[82850]: DEBUG nova.objects.instance [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:33:49 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 08:33:49 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:33:49 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:33:49 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:33:49 user nova-compute[82850]:   <serial>fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb</serial>
Apr 12 08:33:49 user nova-compute[82850]: </disk>
Apr 12 08:33:49 user nova-compute[82850]:  {{(pid=82850) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 08:33:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vda, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:33:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82850) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 08:33:50 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] No VIF found with MAC fa:16:3e:68:74:16, not building metadata {{(pid=82850) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 08:33:50 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.104s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:33:51 user nova-compute[82850]: INFO nova.compute.manager [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Detaching volume fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb
Apr 12 08:33:51 user nova-compute[82850]: INFO nova.virt.block_device [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Attempting to driver detach volume fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb from mountpoint /dev/vdb
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Attempting to detach device vdb from instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 from the persistent domain config. {{(pid=82850) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:33:51 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:33:51 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:33:51 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:33:51 user nova-compute[82850]:   <serial>fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb</serial>
Apr 12 08:33:51 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:33:51 user nova-compute[82850]: </disk>
Apr 12 08:33:51 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:33:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 from the persistent domain config.
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 from the live domain config. {{(pid=82850) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.guest [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 08:33:51 user nova-compute[82850]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 08:33:51 user nova-compute[82850]:   <source dev="/dev/sdb"/>
Apr 12 08:33:51 user nova-compute[82850]:   <target dev="vdb" bus="virtio"/>
Apr 12 08:33:51 user nova-compute[82850]:   <serial>fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb</serial>
Apr 12 08:33:51 user nova-compute[82850]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 08:33:51 user nova-compute[82850]: </disk>
Apr 12 08:33:51 user nova-compute[82850]:  {{(pid=82850) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-1a35f467-a749-4f25-af8f-0b35f2c14dec None None] Received event <DeviceRemovedEvent: 1681288431.6156762, 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82850) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.driver [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 08:33:51 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully detached device vdb from instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 from the live domain config.
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] calling os-brick to detach iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f194c2c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdebuJrs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 08:33:51 user nova-compute[82850]: WARNING os_brick.initiator.connectors.base [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c3352-7a3c-4009-9449-f0c03f2ad96d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 08:33:51 user nova-compute[82850]: No targets found.
Apr 12 08:33:51 user nova-compute[82850]: iSNS:
Apr 12 08:33:51 user nova-compute[82850]: No targets found.
Apr 12 08:33:51 user nova-compute[82850]: STATIC:
Apr 12 08:33:51 user nova-compute[82850]: Target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb
Apr 12 08:33:51 user nova-compute[82850]:         Portal: 172.16.0.220:3260,-1
Apr 12 08:33:51 user nova-compute[82850]:                 Iface Name: default
Apr 12 08:33:51 user nova-compute[82850]: FIRMWARE:
Apr 12 08:33:51 user nova-compute[82850]: No targets found.
Apr 12 08:33:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 08:33:51 user nova-compute[82850]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 08:33:51 user nova-compute[82850]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82850) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb', 0)] {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c72e2dc-8c43-4624-95ae-44529955ff5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[319cfb51-2cc0-4b5e-834f-8eb05586410d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)
Apr 12 08:33:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb (non-flash)
Apr 12 08:33:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f194c4ef6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb'): ({'sdb'}, set())}) {{(pid=82850) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Removing single pathed devices sdb {{(pid=82850) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33cc078-f73e-4f84-ac45-4d99f5628ae8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88a397-618a-463c-825d-857baf2148c9]: (4, ('ok\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flushing IO for device /dev/sdb {{(pid=82850) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8371d355-e746-4565-b550-ea5a448e7ede]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82850) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4700dac-7ebe-47f4-aa2d-e45b2c40b216]: (4, ('1', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.linuxscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] SCSI volumes sdb have been removed. {{(pid=82850) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb')] {{(pid=82850) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23f306-0f41-4dac-86cd-ebf1476a7154]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --logout {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dab2fd-7988-4e6e-8520-f75603ff666a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260]
Apr 12 08:33:51 user nova-compute[82850]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb, portal: 172.16.0.220,3260] successful.
Apr 12 08:33:51 user nova-compute[82850]:  stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op delete {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93535) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3c74a-61e5-4ef6-9865-8c86c8761cae]: (4, ('', '')) {{(pid=93535) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82850) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.base [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] <== disconnect_volume: return (298ms) None {{(pid=82850) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 08:33:51 user nova-compute[82850]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Disconnected iSCSI Volume {{(pid=82850) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 08:33:52 user nova-compute[82850]: DEBUG nova.objects.instance [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'flavor' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:33:52 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:33:53 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:58 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG oslo_concurrency.processutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82850) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 08:33:59 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:33:59 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=26.019481658935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82850) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:33:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:01 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:03 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquired lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Forcefully refreshing network info cache for instance {{(pid=82850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 08:34:04 user nova-compute[82850]: DEBUG nova.objects.instance [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lazy-loading 'info_cache' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:34:05 user nova-compute[82850]: DEBUG nova.network.neutron [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [{"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:34:05 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Releasing lock "refresh_cache-83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" {{(pid=82850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 08:34:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updated the network info_cache for instance {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 08:34:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:08 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:11 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:13 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:16 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:18 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:23 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:28 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:29 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:33 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:38 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:41 user nova-compute[82850]: INFO nova.compute.manager [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Terminating instance
Apr 12 08:34:41 user nova-compute[82850]: DEBUG nova.compute.manager [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Start destroying the instance on the hypervisor. {{(pid=82850) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-unplugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] No waiting events found dispatching network-vif-unplugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG nova.compute.manager [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-unplugged-ef876483-6e28-412d-812e-4dcc46a83e72 for instance with task_state deleting. {{(pid=82850) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 08:34:41 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Instance destroyed successfully.
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.objects.instance [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'resources' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=82850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.virt.libvirt.vif [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T08:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1363091089',display_name='tempest-AttachVolumeNegativeTest-server-1363091089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1363091089',id=47,image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHZCSN81t3Io3Y++NE4Gh0YasDUXE842ZBA6mOygVjGPbzO4CGVo8mbqa+gXO481QBrTnr6SFedIV8i+AuHemQ7wQMrEXDAgFVNa9s9LF3GPqX9JOFdDmQgrejfgLEvTg==',key_name='tempest-keypair-1879219279',keypairs=<?>,launch_index=0,launched_at=2023-04-12T08:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a47cb4fc9e2640399e7df51f12de123d',ramdisk_id='',reservation_id='r-0bsbgf3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='68a0a523-85da-4c40-ac88-5d5f304c0b18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1980986093',owner_user_name='tempest-AttachVolumeNegativeTest-1980986093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T08:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc8316aee1bb41ef99be6777924a33d8',uuid=83e1d52a-a5aa-47ac-85ef-ef85ca3afb95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converting VIF {"id": "ef876483-6e28-412d-812e-4dcc46a83e72", "address": "fa:16:3e:68:74:16", "network": {"id": "4602b19a-1eba-495e-be34-e3bd36c8e0b0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1367112548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a47cb4fc9e2640399e7df51f12de123d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef876483-6e", "ovs_interfaceid": "ef876483-6e28-412d-812e-4dcc46a83e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.network.os_vif_util [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e') {{(pid=82850) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG os_vif [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e') {{(pid=82850) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef876483-6e, bridge=br-int, if_exists=True) {{(pid=82850) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:42 user nova-compute[82850]: INFO os_vif [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:74:16,bridge_name='br-int',has_traffic_filtering=True,id=ef876483-6e28-412d-812e-4dcc46a83e72,network=Network(4602b19a-1eba-495e-be34-e3bd36c8e0b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef876483-6e')
Apr 12 08:34:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Deleting instance files /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95_del
Apr 12 08:34:42 user nova-compute[82850]: INFO nova.virt.libvirt.driver [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Deletion of /opt/stack/data/nova/instances/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95_del complete
Apr 12 08:34:42 user nova-compute[82850]: INFO nova.compute.manager [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 08:34:42 user nova-compute[82850]: DEBUG oslo.service.loopingcall [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82850) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.compute.manager [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Deallocating network for instance {{(pid=82850) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] deallocate_for_instance() {{(pid=82850) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 08:34:42 user nova-compute[82850]: DEBUG nova.network.neutron [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Updating instance_info_cache with network_info: [] {{(pid=82850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 08:34:42 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Took 0.67 seconds to deallocate network for instance.
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:43 user nova-compute[82850]: INFO nova.scheduler.client.report [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Deleted allocations for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Acquiring lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Lock "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] No waiting events found dispatching network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 08:34:43 user nova-compute[82850]: WARNING nova.compute.manager [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received unexpected event network-vif-plugged-ef876483-6e28-412d-812e-4dcc46a83e72 for instance with vm_state deleted and task_state None.
Apr 12 08:34:43 user nova-compute[82850]: DEBUG nova.compute.manager [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Received event network-vif-deleted-ef876483-6e28-412d-812e-4dcc46a83e72 {{(pid=82850) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 08:34:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:34:57 user nova-compute[82850]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681288482.2056918, 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => Stopped> {{(pid=82850) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 08:34:57 user nova-compute[82850]: INFO nova.compute.manager [-] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] VM Stopped (Lifecycle Event)
Apr 12 08:34:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-9d69bc47-dd74-4618-a2bb-b31348dec9e1 None None] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Checking state {{(pid=82850) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 08:34:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:34:57 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:57 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:34:59 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:35:00 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:35:00 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=26.038532257080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:35:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:35:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:03 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:04 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:35:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:35:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:35:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:37 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:42 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:47 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:52 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:35:57 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:35:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:59 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:35:59 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82850) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 08:36:00 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:36:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:36:00 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:36:00 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Auditing locally available compute resources for user (node: user) {{(pid=82850) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 08:36:01 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:36:01 user nova-compute[82850]: WARNING nova.virt.libvirt.driver [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=26.02786636352539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82850) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82850) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing inventories for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating ProviderTree inventory for provider 27ffe403-b11c-48c3-a0f8-372b48def01d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Updating inventory in ProviderTree for provider 27ffe403-b11c-48c3-a0f8-372b48def01d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing aggregate associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, aggregates: None {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Refreshing trait associations for resource provider 27ffe403-b11c-48c3-a0f8-372b48def01d, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82850) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.provider_tree [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed in ProviderTree for provider: 27ffe403-b11c-48c3-a0f8-372b48def01d {{(pid=82850) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.scheduler.client.report [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Inventory has not changed for provider 27ffe403-b11c-48c3-a0f8-372b48def01d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82850) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG nova.compute.resource_tracker [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Compute_service record updated for user:user {{(pid=82850) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 08:36:01 user nova-compute[82850]: DEBUG oslo_concurrency.lockutils [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=82850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:02 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:05 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 08:36:05 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] There are 0 instances to clean {{(pid=82850) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 08:36:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Starting heal instance info cache {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 08:36:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Rebuilding the list of instances to heal {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 08:36:06 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Didn't find any instances for network info cache update. {{(pid=82850) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 08:36:06 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:07 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:08 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:10 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:12 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:36:17 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82850) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82850) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 08:36:22 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:24 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:24 user nova-compute[82850]: DEBUG nova.compute.manager [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82850) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 08:36:27 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 08:36:31 user nova-compute[82850]: DEBUG oslo_service.periodic_task [None req-c28932cb-59ca-4c82-92b9-4a6d0eed532c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82850) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 08:36:32 user nova-compute[82850]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=82850) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}